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SECTION I 
INTRODUCTION 

The selection of an instructional delivery system is an important 
step in the training system design process. An instructional delivery 
system is made up of the student and all of the elements with which he 
interacts to achieve instructional goals. The structure of this delivery 
system determines in a major way how the information pertinent to training 
is to be organized and presented to the student. The choice of the 
delivery system affects not only training effectiveness but also the 
costs of instruction. For example, in the systems engineering approach, 
instructional delivery system choices are determined from trade-off 
studies which consider the relevant alternatives for training and the 
associated costs. Choosing the delivery system with an optimum mix of 
instructional media is difficult to accomplish in an intuitive, informal 
manner. A systematic approach to media and instructional delivery 
system selection is required which is formalized in the training system 
design process. 

Recently, the Training Analysis and Evaluation Group (TAEG) examined 
the available formal media selection techniques for possible use in Navy 
training system design. From this grouping, the 10 most promising 
published techniques were selected and critically examined. None of the 
techniques was found adequate for use in developing specifications for 
Navy instructional delivery systems, The results of this investigation 
are presented in TAEG Report No. 8. 

The available formal media selection techniques suffer various 
shortcomings. All tend to be imprecise (vague, ambiguous terminology) 
and too gross in categorizing the factors that influence the media 
selection process. They also lack generality. The available techniques 
are tailored to specific training environments and are inappropriate to 
a range of training situations such as found in the Navy. To be workable, 
they also require considerable intuitive jiidgments on the part of the 
training system designer. The existing approaches are incomplete in 
that they do not account for all the critical variables in the media 
selection process. Prominent factors thrt must be considered include 
the nature of the tasks and task structure, the learning strategies 
appropriate to these tasks, the media types available for instruction, 
and the procurement, operating and updating costs of alternative media 
mixes. Other prominent factors are the state of development of proposed 
media approaches, resources required for courseware development, and the 
characteristics of the anticipated student population. 

1 Richard Braby, An Evaluation of Ten Techniques for Choosing Instructional 
Media, TAEG Report No. 8, December 1973. Training Analysis and Evaluation 
Group, Orlando, Florida. 
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What is needed are means for reducing the weaknesses inherent in 
existing media selection schemes and to consider all elements of the 
instructional delivery system. The selection procedure presented in 
this report, called the Training Effectiveness and Cost Effectiveness 
Prediction (TECEP) technique, is an attempt in this direction. 

This report presents an operational description of the TECEP tech-g 
nique. The ground work for the technique was laid in TAEG Report No, 1. 
xH its present form, the TECEP procedure has incorporated the design 
requirements for an optimum media selection technique articulated in 
TAEG Report No. 8.^ A one-year field trial of the draft version of this 
report resulted in additional refinements which have been incorporated 
into this final report. However, the technique continues to possess 
some of the worrisome limitations ascribed to the previously available 
techniques. The choosing of an optimum instructional delivery system 
for various types of military training objectives remains a subtle and 
complex decision-making task; something that cannot be fi;lly procedural - 
ized. Training system designers who use the TECEP technique must possess 
expert knowledge of media. The technique will serve as a performance 
aid in carefully exploring the probable cost and effectiveness of various 
alternatives, including innovations. 

PURPOSE 

The purpose of this report is to make available to training special- 
ists a procedure for choosing instructional delivery systems appropriate 
to various types of military training. The TECEP technique serves as a 
performance aid for the training specialist to use in defining appropriate 
training strategies for training objectives, choosing instructional 
delivery systems capable of carrying out the training strategies, and 
identifying the relative cost of these alternatives. Through the use of 
this procedure, training specialists choose the cost-effective instruc- 
tional delivery system over its competitors. 

ORGANIZATION OF THE REPORT 

In addition to section I, two other major sections are presented. 
Section II provides an overview of the TECEP technique. The basic 
concepts and terms employed are defined. Section III provides reference 

2 Staff Study on Cost and Training Effectiveness of Proposed Training 
Systems , TAEG Report No. 1, 1972. Training Analysis and Evaluation 
Group, Orlando, Florida. 

3 Richard Braby, An Evaluation of Ten Techniques for Choosin g Instructional 
Media , TAEG Report No. 8, December 1973. Training Analysis and Evaluation 
Group, Orlando, Florida. 
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materials used in choosing delivery systems. A formal three-step 
selection procedure is described and illustrated through the use of a 
sample problem. 

Supporting information is presented in three appendices. Appendix 
A provides an alternate method for step 2 in the TECEP procedure, the 
selection of candidate instructional delivery systems. A wider range of 
solutions can be considered using the alternate procedure. Appendix B 
contains an analysis of the equations and economic theory in the cost 
model, and appendix C provides a Fortran IV program listing of the cost 
model . 

A series of three reports contains the inforiR^^ion needed to use 
the TECEP technique. In support of the material ir •;h1o report are TACG 
Report No. 23,^ which provides the learning models used in selecting 
delivery systems, and TAEG Report No. 24, ^ which provides a detailed 
sample application of this technique. 



James A. Aagard and Richard Braby, Learning Guidelines and Algorith ms 
for Twelve Types of Training Objectives , TAEG Report No. 23. Training 
Analysis and Evaluation Group, Orlando, Floriaa (manuscript form, to 
be published mid-1975). 

Richard Braby, Choosing Instructional Delivery Systems with the TECEP 
Technique - A Case Study , TAEG Report No. 24. Trainingl^lysTs and 
Evaluation Group, Orlando, Florida (manuscript form, to be published 
mid-1975). 
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SECTION II 

OVERVIEW OF THE TECEP TECHNIQUE 
BACKGROUND 

The TECEP is a technique for selecting cost-effective instructional 
delivery systems for proposed training programs. It provides an orderly 
approach to making delivery system choices during the conceptual design 
phase. A sequence of steps is provided for identifying generic types of 
delivery systems capable of accomplishing designated training objectives 
and for determining the costs of owning each of these types of training 
systems. 

As defined in section I, an instructional delivery system is made 
up of the student and all of- the elements with which he interacts to 
achieve the instructional goals. Included are the instructional media, 
both hardware and courseware, the instructor, other students in peer 
instruction, and the direct supporting services for equipment maintenance 
and courseware development. While media may be a prominent part of an 
instructional delivery system, the choice of a medium includes a package 
of all of the elements in the instructional delivery system. Therefore, 
the availability and effectiveness of each of the elements in the 
delivery system must be considered in making a media choice. 

The TECEP technique requires user e^rpertise. It is not a mechanical 
procedure. It requires the design team to make a series of key decisions 
which influence significantly the resultant media mix alternatives. The 
TECEP is best described as a job aid for an experienced training system 
designer. What it provides is a pathway and procedures for systematic- 
ally coming to grips with critical issi'es in planning for cost-effective 
instruction. 

Figure 1 shows the general sequence of the instructional system 
design process and identifies the chief function which can be performed 
using the TECEP technique. 

TECEP LOGIC 

The process of selecting instructional delivery systems is formally 
initiated when the training objectives for. a proposed training system 
have been received. A set of training objectives are an input to the 
TECEP process. Starting with this set of objectives a sequence of steps 
is accomplished for deriving appropriate learning strategies, identifying 
instructional delivery systems capable of supporting these strategies, 
and determining costs associated with these delivery systems. The 
output of this effort is a description of an optimum instructional 
delivery system for accomplishing the training objectives. The TECEP 
process flow is shown in figure 2. Each of the elements in this process* 
is described in subsequent paragraphs; the specific materials and guide- 
lines for their use are provided in section III of this report. 
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CHOOSE LEARNING ALGORITHMS FOR TRAINING OBJECTIVES. An algorithm is "a 
precise, generally comprehensible prescription for carrying out a defined 
sequence of elementary operations in order to solve any problem belonging 
to a certain class. "° Therefore, a learning algorithm is a step-by-step 
prescription for a student to follow in learning any specific task in a 
class of learning tasks, such as procedure following or decision making. 
It is a general sequence for use with all similar training objectives. 
Learning algorithms have been prepared for the more commonly experienced 
types of military training tasks. Within the TECEP approach, each 
training objective is matched with one of the learning algorithms. 

IDENTIFY INSTRUCTIONAL DELIVERY SYSTEMS FOR EACH SET OF SIMILAR TRAINING 
OBJECTIVES. A student must be able to carry out each of the steps in 
the algorithm selected for a given set of objectives. An instructional 
delivery system is to be selected that enables this sequence of events 
to take place. The delivery system shall be capable of (1) displaying 
the essential stimulus characteristics of the subject matter; i.e., 
color, motion, sound; (2) allow the student to respond appropriately; 
i.e., choose an answer or manipulate a control; and (3) provide the 
student with the required form of feedback and reinforcement; i.e., his 
scores or a dynamic change in the performance of the system. All of 
these events are specified within the algorithms. In part, the TECEP 
technique serves as a performance aid for the training system designer 
to use in identifying all those delivery systems with the stimulus, 
response, and feedback capabilities required to carry out the events in 
the selected algorithn 

ESTIMATE THE COST OF ALTERNATIVE SYSTEMS. The cost of using an instruc- 
tional delivery system is the total value of all resources consumed in 
that part of the training program supported by the instructional delivery 
system. Included are the costs of the equipment, the curriculum materials, 
the personnel (e.g., instructors and support personnel), the supplies 
consumed, the facilities supporting the use of the system, and the wages 
and other costs of the student who learns from the system. These costs 
can be estimated with the aid of a formal cost model. This cost model 
is designed to display the cost implications of substituting one medium 
for another in a delivery system or for comparing entirely different 
instructional delivery systems. 

CHOOSE COST-EFFECTIVE INSTRUCTIONAL DELIVERY SYSTEM OR MIX OF SYSTEMS. 
To be cost effective a delivery system must (1) facilitate student 
learning of the required behavior and (2) have a relatively low use cost 
when compared with other systems also able to support the required 
learning. Using the TECEP technique, a training system design team 
chooses an instructional delivery system based on estimated training 
effectiveness and cost. Solutions which minimize resource consumption 
while meeting training objectives become prime candidates for incorpora- 
tion into the proposed training system. 

^ N. Landa, Algorithmization in Learning and Instruction , Englewood 
Cliffs, N.J.: Educational Technology Publications, 1974, p. 11. 
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REQUIRED REFERENCE MATERIALS 

Various types of reference materials pertinent to the TECEP process 
flow are described next. They serve as printed job aids to be used in 
carrying out each of the steps in the selection of a delivery system. 
Figure 3 identifies these aids, and an introductory description of each 
item is presented next. The actual reference materials and directions 
for their use are presented in section III. 

TWELVE TYPES OF LEARNING ALGORITHMS WITH THE CHARACTERISTICS OF TRAINING 
OBJECTIVES THEY SUPPORT. Learning algorithms have been developed for 
fundamentally different types of training objectives representing military 
tasks. They are based, in part, on the Willis and Peterson^ list of 
common Navy tasks and are designed so that (1) a wide range of tasks can 
be grouped into a small number of categories, (2) all the training 
objectives in one category can be achieved by using a single learning 
algorithm, and (3) each category of training objectives requires a 
different learning algorithm; i.e., fundamentally different from the 
training strategies required by other classes of training objectives. 

Only the names of the learning algorithms and the characteristics 
of the training objectives they support are included in this volume. 
The actual algorithms are presented in a companion volume. Learning 
Guidelines and Algorithms for Twel ve Types of Training Objec tives, TAEG 
Report 23, to be published mid-1975. ~ 

INSTRUCTIONAL DELIVERY SYSTEM SELECTION CHARTS. A table is presented 
for each of the 12 learning algorithms. Across the top of each is a 
comprehensive list of instructional delivery systems that generally can 
be used to carry out the steps in the algorithm. On the left side are 
listed special selection criteria. These criteria may include stimulus 
requirements and other training setting and administrative criteria 
unique to specific training programs. An "X" appears in those cells of 
the table where the instructional delivery system meets the special 
criteria. 

By entering the table with those special criteria required by a 
training program, useful alternative delivery system approaches can be 
quickly identified. 



M. Paul Willis and Richard 0. Peterson, Deriving Training Device 
Implications from Learning Theory Principles , Vols, I, II, and III, 
Technical Report: NAVTRADEVCEN 784-1 . July 1961. U.S. Naval Training 
Device Center, Port Washington, NY. 
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TEST OF PRACTICALITY. Eleven criteria required for practical training 
system proposals are listed. Impractical solutions that do not meet 
-e criteria are screened out. 

C^ MODEL. This model is a series of mathematical equations representing 
the cost of using instructional delivery approaches in a training system. 
It incorporates a list of cost factors to be considered and a procedure 
for combining these factors. The model includes the cost of acquiring and 
operating ficilities and equipment, the cost of supplies, the cost of the 
design of instructional materials, the cost of support personnel, and 
student costs associated with the use of each specific instructional 
delivery system. By exercising the model for two or more alternatives, a 
comparison can be made of the costs of using different types of instruc- 
tional delivery systems. The cost advantages or disadvantages of each 
system become apparent from the output of the model. The model has been 
designed to be responsive to the requirements for economic analysis as 
specified in DoD Directive 7041.3 and SECNAVINST 7000. 14A. 

ADDITIONAL SUPPORTING DATA 

Figure 3 also provides additional data to aid the user in the practical 
application of the TECEP technique. Each type of data is described in 
subsequent paragraphs. The actual materials are located in the appendixes 
of this report and also in the companion reports mentioned earlier. 

LEARNING GUIDELINES AND ALGORITHMS. The learning guidelines and algorithms 
described below are presented in a separate volume (TAEG Report No. 23) so 
that training system designers can more conveniently use these aids in a 
variety of steps in the instructional system development process. The 
separate volume can be used in choosing instructional events during the 
planning of a curriculum and in preparing storyboards and scripts during 
media development, as well as in selecting delivery systems. 

Learning G uidelines . These guidelines are statements which prescribe 
specific characteristics to be built into the design of a training 
system. Guidelines are based in part on learning theory and in part on 
practical experience. They are prepared in groups to describe the major 
characteristics required in a training system to accomplish a given type 
of training task. Groups of learning guidelines have been developed for 
the 12 types of training objectives. 

Learning Algorithms . A learning algorithm has been prepared to represent 
each of the 12 sets of learning guidelines. Each describes a sequence 
or pattern of events called for by the learning guidelines. Presented 
as flow diagrams, they indicate the data processing requirements for 
carrying out the intent of the learning guidelines. 
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Application of TECEP Technique . The guidelines and algorithms are 
presented as tentative statements and may vary in usefulness with the 
complexity of the training problems. While the sets of guidelines and 
algorithms display less than proven solutions to classes of training 
problems, they are thought to represent the best information available 
today for prescribing general solutions. 

Accepting or rejecting an instructional delivery system is based on 
the criterion of whether it will support the use of the appropriate set 
of learning guidelines and related algorithm. It must be feasible to 
carry out all operations of the algorithm within the proposed delivery 
system for the system to be identified as a useful alternative. While 
the Instructional Delivery System Selection Charts contain alternatives 
that meet this criterion, the designer may wish to perform his own 
analysis, or to consider a media-mix not presented on a chart. The 
guidelines and algorithms, therefore, are available to support this 
function if he chooses to use them. Familiarity with these guidelines 
and algorithms is essential to an understanding of the TECEP technique. 

ALTERNATE METHOD FOR CHOOSING INSTRUCTIONAL DELIVERY SYSTEMS. A method 
is provided for the designer to consider delivery systems not included 
in the formal Instructional Delivery System Solution Charts. With this 
method, generic media characteristics required to implement the learning 
algorithms are stated, and media containing these characterists are 
identified. 

To support the designer in applying this method, two performance 
aids are provided. The first is a list of generic media characteristics. 
This refers to fundamental or basic capabilities found in the structure 
of many types of instructional media. Fifty- five generic media character- 
istics have been identified. The list includes stimulus characteristics 
such as "sound'* and "color," trainee response modes including "multiple 
choice" and "tracking," and performance feedback characteristics that 
can be used as standard media descriptors in defining existing types of 
instructional media. They can also be used in prescnbing the general 
characteristics required of a medium for a proposed instructional delivery 
system, thus aiding the designer in choosing types of media that contain 
all the required characteristics. 

The second aid is called a media pool. It is a list of 89 general 
types of instructional media that can be incorporated into instructional 
delivery systems. Each is defined and described. Included are media of 
various levels of development: operational forms of instructional 
material such a programmed texts and motion pictures, forms under develop- 
ment such as various types of computer-assisted instruction and computer 
simulation games, and media concepts that have not yet reached the 
prototype or pilot project stages such as video disc and microform with 
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information mapping. The list includes a broad range of media types, 
from printed and recorded media such as motion pictures and broadcast 
television to three-dimensional "hands-on" media such as mock-ups and 
simulators. 

COST MODEL: DISCUSSION, ASSUMPTIONS AND LIMITATIONS. Background data 
on the cost model including economic concepts and equations that make up 
the cost model are presented, and all terms are defined. An understand- 
ing of these economic concepts and equations will aid the designer in 
assigning values to the variables in the cost model and in interpreting 
the output of the model. Limitations of the model are described to aid 
the analyst in avoiding certain pitfalls in interpreting the cost model 
output data. 

FORTRAN PROGRAM OF COST MODEL. Manual use of the cost model involving 
hand calculation is a tedious undertaking. To aid training system 
designers in the use of the cost model, a program listing of a FORTRAN 
IV program of the cost model is provided, with a sample of the input 
data. Instructions for the use of the program are included. 

POST NOTE 

Potential users of the TECEP technique should be aware of limitations 
of the technique. It deals with highly simplified descriptions of 
proposed training systems. The TECEP technique is used as a performance 
aid in conducting trade-off studies of alternatives prior to the detailed 
development of any one of the alternatives. Only the major parameters 
of these systems are considered. 

In addition, certain terms used in the equations must be assigned 
estimated values' due to the absence of available quantitative data. 
Also, subjective interpretations are made at certain key points in the 
process. Thus, user expertise is required. 

The technique encourages the consideration of unorthodox training 
solutions in that a wide range of alternative media are examined prior 
to final solution. Therefore, the TECEP technique is not appropriate in 
design situations where instructional delivery system choices are con- 
strained or where operational practices or policies rule out many pertinent 
forms of media. 

The learning algorithms in the technique represent training approaches 
for most of the important types of Navy training tasks. No claim is 
made that all types of Navy training are included. There will be instances 
where a new training requirement may fall outside the list of training 
objective classes considered in this technique, or where it might be 
represented only by a complex mix of these categories and, therefore, be 
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difficult to align with a specific learning algorithm. The learning 
guidelines and algorithms are less than final and in actual use must be 
adjusted to accommodate specific situations. The media classes do not 
discriminate between the extensive variations that exist within many of 
the classes. In certain instances, therefore, following the detailed 
TECEP procedures will not be productive, but the use of the media list, 
the cost model, and other parts of the procedure may still be useful. 

The procedure and the guidelines presented in section III must be 
used with these cautions in mind. The technique is not inviolate, and 
the quality of the output will be dependent on the expertise of the 
designers. 
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SECTION III 

THE TECEP TECHNIQUE 

The TECEP technique for choosing cost-effective instructional 
delivery systems can be used as a detailed step-by-step procedure or it 
can be used generally, in a less structured manner, as background informa- 
tion in making delivery system choices. 

The technique consists of three steps as shown in table 1. Each 
step is described in detail with appropriate guidelines in this section. 
For ease of usage, each step is presented on a separate page, followed 
by an example of the step. Reference tables (2 through 14) required to 
carry out these steps have been placed in the back of this section. 
Tabs have been placed on each of the frequently used references to aid 
the designers in the repeated use of these materials. 



TABLE 1. STEPS IN THE TECEP TECHNIQUE 



GIVEN: 


Training Objectives for a 
Course of Instruction 


Step 1 


Classify and group training 
objectives according to the type 
of learning algorithm required 
to accomplish the objectives. 


Step 2 


For each group of objectives, 
identify two or more types uf 
instructional delivery systems 
that will support the use of the 
required algorithm. 


Step 3 


Estimate the cost of using each 
alternative delivery system to 
train the required number of 
students to meet the objectives. 


Then: 


Choose the cost-effective 
instructional delivery system, 
or mix of systems. 
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Step 1 • Classify and group training objectives according to the type 
of learning algorithm required to accomplish the objectives . The initial 
step is to match each training objective in the proposed training system 
with the name of the learning algorithm appropriate for achieving the 
objective. The names of 12 learning algorithms and the characteristics 
of training objectives that can be accomplished with these algorithms 
are listed in table 2. A tentative classification of a training objective 
is accomplished by merely matching the objective with the name of one of 
the learning algorithms. This classification can be verified by comparing 
the characteristics of the training objective with the action verbs, 
behavioral attr^^tJ^^s, and examples of objectives that can be achieved 
with that type . ^orithm, as listed in table 2. Use only the predomi- 
nant or critical v ^aracteristics of the training objective in making 
this dete inination. If two or more algorithms appear to be required for 
a trainin9 objective, consider dividing the objective into two or more 
simpler objectives which can each be accomplished with a single algorithm. 
Group the training objectives into sets that are classified alike. 

The reader may wish to review TAEG Report No. 23^ for background 
information on the learning algorithms and the learning guidelines upon 
which they are based. 

An example of this step demonstrates the procedure: 

Training Objective . Given (1) an operational RF signal generator, 
Hewlett Packard 614A, (2) the characteristics of the signal to be generated, 
and (3) an operator's checklist, the trainee will operate the equipment; 
i.e,, he will describe and then perform each step in the equipment turn- 
on and set-up procedure, proceeding through tlie checklist without error. 

This training objective has been matched with learning algorithm 
Number 9, Recalling Procedures , Positioning Movement . This match is 
appropriate in that the characteristics of the training objective are 
similar to two of the examples, all the behavioral attributes, and one 
of the action verbs listed for this type of learning algorithm, as shown 
by the checks in figure 4. 



J. A. Aagard and R. Braby, Learning Guidelines and Algorithms for 
Twelve Types of Training Objectives , TAEG Report No. 23. Training 
Analysis and Evaluation Group, Orlando, Florida (manuscript form, to 
be published mid-1975). 
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NAMES OF 
LEARNING 
ALGORITHMS 

9* RECALLING 
PROCEDURES, 
POSITIONINGi 
MOVEMENT 



CHARACTERISTICS OF TRAINING OBJECTIVES THAT CAN BE 
ACHIEVED WITH SPECIFIC ALGORITHMS 



ACTION 
VERBS 



BEHAVIORAL ATTRIBUTES 



Activate v/l. 
Adjust 

Align ^ \A. 
Assemble 
Calibrate 
Disassemble 
Inspect 
vOperate 
Service 



Concerns the chaining 1 
or sequencing of events. 
Includes both the cog- 
nitive and motor 
aspects of equipment 
set-up and operating 
procedures. 

Procedural check lists 
are frequently used 
as job aids. 



\/2. 



EXAMPLES 

Recalling equipment 
assembly and dis- 
assembly procedures. 
Recalling the opera- 
tion and check-out 
procedures for a 
piece of equipment 
(cockpit check lists). 
Following equipment 
turn-on procedures - 
errphasis on motor 
behavior. 



Figure 4. Sample of Matching Training Objective Characteristics 
with a Type of Learning Algorithm 
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RECALLING PROCEOURf.S AND POSITIONING MOVEMENT 



Dir«ctionitii 

TO choo«« * <eliv«ry 

1. rUc« « V* <li9ht 
pencil) in box«i 
r«pr«a«ntin4 criteria 
(rowi) th«t Buit b« 

2. Select the delivery 
lyateai Icoluans) th«t 
h«ve «n *X" in e«ch row 
deitqnAted by « *J* , 
Theie «re the candidate 
delivery lyitcai. 



Criterle for 
Selectin9 
Initructlenal 
Del ivery 
Systeai 



Alternative X n^tr uct ionil Delivery ,^y*.t<n^ 



Delivery Approaches 
feraittinq the Application 
of All Le«rnin« Cuidelinei 
end Alforttha 



Delivery A|>| r^Ach* m x 
reraittinf co»pl« t* 
Application of Loarniri 
Cuidelinvi «nj Al*ioriM^ 



A 



*/ o 



e A 
e 

e. u 
u • 
e o. 



e <9 



A 



A 



"7 



Coaplcxity Criteria 

• Difficult Hotor Acti 

• Saooth Hotor Pcrferaancc at 

End of Trainin9 

Stiaului Criteria 

• Viiual rora 

Alpha*Huacric 
rictorial* Plane 
Object. Solid 

• Viiual Hoveaent 

Still 

full Heveaent 

• Audio 

Voice Sound Kanfe 
full Sou.ii K*n«e 
Aakient Soundi 

• Other 

Tactile Cues 

Internal Stiaului Hotlon Cuei 



Trainin9 Scrttin? Criteria 

• Individual Trainee «t rixed Location 

• Individual Trainee witN Independent 
Initruction at Any Location 

• Srall Croup 

• Larfe Group at Single Location 

• TeaSi Setting 



Adaini)tr^*tive Criteria 

• Site of Cour^Ovare and Special Hard* 
ware Develepaent 

Local 
Central 

• Ha^nltcdc- of Ac<iuiiitiOn Coit 

Low 
II Hh 



Figure 5. Sample of Delivery System Selection 
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Step 2. For each group of objectives , identify two or more types of 
instructional delivery sys terns which will support the us£ of the required 
algorithm . Use the Instructional Delivery System Selection Charts, 
tables 3 through 14, to perform the first part of this Step in the 
procedure. First, locate the chart representing the algorithm selected 
in Step 1. The chart for the algorithm. Recalling Procedures and Position- 
ing Movement, required in the sample problem is provided as figure 5. 
Note that the columns headed Alternative Instructional Delivery Systems 
are divided into two sections; i.e., those permitting the full use of 
the algorithm and those not permitting full use. The latter group 
includes some existing or traditional practices that are considered to 
be less powerful or efficient than those enabling the full use of the 
algorithm. The designer may wish to add additional approaches to either 
side of the chart. 

Along the left side of the chart special criteria are listed for 
selecting from the delivery systems presented across the top of the 
chart. While a large number of criteria had to be satisfied during the 
development of the chart, only those unique to specific applications 
need be co.isidered by the designer. Those criteria presented generally 
concern the stimulus demands of the subject matter, requirements of the 
training setting, and certain administrative and budgetary constraints 
unique to the specific instructional program. 

A blank column, with the heading "Directions" appears on the chart 
immediately to the right of the criteria list. To use the chart, place 
a light check in pencil in those cells designating criteria that must be 
satisfied by the delivery system. Then determine which delivery systems 
meet all these special criteria. 

This part of the procedure for Step 2 has been carried out in 
figure 5. Note the criteria that were checked as being essential to the 
training program^for this objective. Also note that only the circled 
delivery systems met all the special criteria. Two permit the full 
algorithm to be used, and one does not support the full use of the 
algorithm. The two tentatively recommended alternatives are: 

1. Operational System in a Laboratory with Tutor 

2. Microfiche with or without Photo or Operable Mock-up. 
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Test of Practicality , Each candidate delivery system should be critically 
evaluated in terms of the following criteria to insure that each is a 
practical solution to the training problem. Reject those alternatives 
that are impractical • 

1. Marginal Technical Solutions — The learning guidelines and 
algorithm cannot be easily carried out with the system, 

2. State-of-the-Art — The system is under development or test 
and may not be available for practical application by the time it is 
required. 

3. Size of System — Some approaches are useful within large 
training programs. Others are suited only for small programs and, 
therefore, may not be suited to the size program being considered, 

4. Interface with Existing Program — Many new courses must be 
designed to fit into existing programs, which place constraints on the 
new courses; e,g,, equipment on hand, available classrooms, scheduling 
practices, ' 

5. Time to Produce System — Approaches which require long lead 
times for development may not be useful when scheduled ready-for-training 
dates do not allow a long development cycle. 

6. Budget Cycle Constraints — While the application of some of 
the Dowerful training approaches, such as CAT (Computer Assisted Instruc- 
tion), may result in low costs per student graduate, the initial investment 
is substantial. Unless these resources appear in existing budgets, the 
applications of these techniques to an immediate problem may not be 
feasible. 

7. Adoption of Innovations — Instructors frequently resist 
innovations. If the proposed technique is significantly different from 
existing techniques, either adequate resources must be focused upon 
gaining acceptance for the innovation, or a more traditional approach 
must be selected. 

8. Courseware Development — If the courseware is to be locally 
developed, skilled personnel, equipment, time, and dollars must be made 
available. 

9. High Cost Alternatives — The projected life cycle cost of a 
media approach may be significantly higher than other equally useful 
alternatives. Reject high cost alternatives when others are available. 

10. Learning Style of Trainees — If the trainee has a low reading 
ability or would be limited in his ability to use certain kinds of systems 
then reject these systems as inappropriate. 

26 
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11. Other Constraints A variety of other practical factors 
should be considered; e.g., command policy and existing investment in 
production facilities. 

In the case of the sample problem, the approach requiring the use 
of operational equipment with a tutor is found to be a practical solution. 
No problems were identified by considering each criterion in the practicality 
test. During consideration of the microfiche-based approach, however, a 
low degree of risk was identified for two items. The first low risk area 
concerned test item Number 2, the "state-of-the-art." Studies involving 
the use of color microfiche in procedure-fol lowing training have not 
been conducted within the Department of Defense. However, applications 
in industry have been successful. Some risk, however, is associated 
with the initial applications of colored microfiche in the military 
environment. The second low risk area concerned test item Number 8, 
"courseware development." It is assumed that the team developing the 
courseware will have no experience in developing microfiche-based courseware. 
This lack of experience is not considered to be a serious problem. 
Skills required would be similar to those used in writing programmed 
texts and making slide sets. The reproduction of the color microfiche 
would be accomplished by a commercial laboratory. 

Both instructional delivery systems survived the practicality test 
and are considered to be candidates for use in the proposed training 
system. 

An alternative approach to Step 2 is presented in appendix A. This 
approach allows the training system design team to consider solutions 
not contained in the Instructional Delivery System Selection Charts. It 
is intended for use by those with an expert knowledge of media. 
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Step 3. Estimate the cost of using each alternative delivery system 
to train the required number of students to meet the objectives . Use 
the Cost Data Collection Form, included as Attachment 1 at the end of 
this report, to record the data necessary to run the cost model for a 
single alternative. Repeat this process for each of the alternative 
instructional delivery systems. Figure 6 presents the cost data in the 
two instructional delivery systems in the sample problem. The values 
assigned to each of the input variables are dictated by the problem 
under analysis. It is, therefore, the responsibility of the training 
specialist to develop these values for his problem. Much of the necessary 
data can be developed from historical information, manuals, and other 
secondary sources. Where no empirical data exists, it may be necessary 
to make estimates for selected variables. These data must be in accordance 
with the definitions shown in appendix B and coded in the format specified 
in appendix C. The coded data along with the working computer program 
in Fortran IV in appendix C can be delivered to almost any data processing 
group for processing. Although the computations can be performed on a 
hand calculator, this is a time-consuming process. Most tasks require 
numerous runs of the program which would require an unacceptable number 
of man-hours for manual computation. 

The output of this procedure is a numerical value for 31 factors 
which describe various aspects of the cost of using a training system. 
One output of the model is the "present cost" of each alternative instruc- 
tional delivery system. The "present cost" represents the amount of 
money that would be necessary at the beginning of the project to implement 
and operate the project over the entire planned life of the system. The 
amount of money held for use during the second and subsequent years is 
credited with interest at a specified rate. The costs for each year in 
the planning period are discounted to reflect this time value of money 
and these discounted costs are summed to obtain the "present cost" of 
the alternative. The justification for discounting evolves from the 
concept that expenditures which are postponed to future years cost less 
in terms of today* s dollars than tomorrow's dollars. With this type of 
cost information, alternative training systems can be compared and the 
systems ranked in terms of their cost. The cost advantages or disadvantages 
inherent in choosing one system over another become apparent. 

Cost summary data for the sample problem generated through the use 
of the cost model are contained in figure 7. Data for the twp candidate 
systems are presented next to each other so that comparisons can be 
easily made. Intermediate output data on each of these alternatives are 
presented in appendix C. Cost analysis ends when system costs have been 
projected for each of the proposed alternative training systems. 
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Instructional Delivery Syste m operational system in a Laboratory With Tutor 



Run I D Example 1 



FORTRAN Symbol 


Variable Description 


VALUE 


Units 


Facilities 








FACOST 


Total facilities acquisition 
and/or refurbishing costs 


o 


Dollars 


LOFFA 


Expected years of life of 
FACOST assets (in whole numbers) 


o 


Years 


SQFTIN 


Total square feet required 
for each instructor 




Sq ft 


SQFTST 


Total square feet required 
per student position 


IS 


Sq ft 


SQFTAM 


Total square feet required 
for administrative overhead 
for all student positions' 




Sq ft 


Equipment 








EQCISP 


Equip, implementation costs 
independent of stud. pos. 




Dollars 


LOFEQl 


Expected years of life of 
EQCISP assets (in whole numbers) 




Years 


EQIMPC 


Equip, implementation costs 
per student position 


3&trt> 


Dollars 


LOFEQ 


Expected years of life of ' 
ECllMPC assets 


10 


Years 


TSPOSD 


Percent of operating time 
student position down 




Percent 



Figure 6. Sample Cost Data on Cost Data Collection Form 
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FORTRAN Symbol 


Variable Description 


Value 


Units 


Instructional Ma 


terial (IM) 




Percent 


UIMD 


% of TLENGH (i.e., time spent 
in traininn mpHium^ "fnr whirh 

III i#iuiiiiiiv^ iiic^j iuiiiy lUi rfliiv«ii 

new instructional material 
must be developed 


UPDATE 


% of original development cost 
required each year to maintain 
instructional material 




Percent 


EVIM 


% of original development cost 
remaining at end of planning 
period 


0 


Percent 


CIMD 


Average cost of developing 
one hour of instructional 
material 


30 


Dollars 


Personnel 
INTSPO 


Instructor to student 
position ratio 


LO 


Decimal 
Ratio 


SALINR 


Annual salary and benefits of 
one instructor 




DO 1 1 ars 


Supplies 
SUPPLY 


Cost of expendable supplies for 
each student while enrolled in 
course 


0 


Dollars 


Students 
STUDSL 


Annual salary and benefits of 
one student 


II /V/ 


Dollars 


STCSTl 


Average student travel cost 
to and from school 


* * J ' * L 


Dollars 


STCST2 


Average per student travel cost 
as a part of course 


0 


Dollars 


Miscellaneous 
N 


Numhpr nf vpar^ in nlanninn nPK'inH 
iiuiiiud ui jrcaio 111 ^laiiiiiiivj pci luu 


/A 
/ L> 


I CU 1 o 


ARATE 


Attritinn ratp 




i CI V«C11 L 


DRATE 


Discount rate 


n.io 


Percent 


WSCHOP 


Wppk^ ^rhnnl ODPratp^ parh vpar 


^ () 




TLENGH 


Average time spent in training 
medium per student 
(non-recycled students) 




Weeks 


TLEGTH 


Average hours per week student 
spends in medium 


3 


Hours 


RCRATE 


Recycle rate 


0 


Percent 


ARCYTM 


Average time the recycled student 
spends repeating material 


0 


Weeks 


ESP 


Percentage of excess student 
positions required to provide 
for fluctuations in input 




Percent 



NOTE J All percent values are entered as decimal equivalents. 



Figure 6. Sample Cost Data on Cost Data Collection Form (continued) 
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Instructional Delivery Syste m Microfiche with photo M ockup 

Run ID Example 2 



FORTRAN Symbol 


Variable Description 


Value 


Units 


Facilities 








FACOST 


Total facilities acquisition 
and/or refurbishing costs 


0 


Dollars 


LOFFA 


Expected years of life of 
FACOST assets (in whole numbers) 


o 


Years 


SQFTIN 


Total square feet required 
for each instructor 




Sq ft 


SQFTST 


Total square feet required 
per student position 




Sq ft 


SQFTAM 


Total square feet required 
for administrative overhead 
for all student positions 




Sq ft 


Equipment 








EQCISP 


Equip, implementation costs 
independent of stud. pos. 


0 


Dollars 


L0FEQ1 


Expected years of life of 
EQCISP assets 


o 


Years 


EQIMPC 


Equip, implementation costs 
per student position 




Dollars 


LOFEQ 


Expected years of life of 
EQIMPC assets (in whole numbers) 


— — 


Years 


TSPOSD 


Percent of operating time 
student position down 




Percent 



Figure 6. Sample Cost Data on Cost Data Collection Form 



32 

ERIC 



TAEG Report No. 16 



FORTRAN Symbol 



Instructional Material (IM) 



Variable Description 



Value 



UIMD 



UPDATE 



% of TLENGH (i.e., time spent 
in training medium) for which 
new instructional material 
must be developed 



% of original development cost 
required each year to maintain 
instructional material 



EVIM 



CIMD 



% of original development cost 
remaining at end of planning 
period 



Average cost of developing 
one hour of instructional 
material 



Personnel 



INTSPO 
SALINR 



Supplies 



SUPPLY 



Students 



Instructor to student 
position ratio 



Annual salary and benefits of 
one instructor 



Cost of expendable supplies for 
each student while enrolled in 
course 



STUDSL 



STCSTl 
STCST2 



Annual salary and benefits of 
one student 



Average student travel cost 
to and from school 



o 



Miscellaneous 



DRATE 
WSCHOP 



Average per student travel cost 
as a part of course 



Number of years in planning period 
Attrition rate 



111. 



Discount rate 



O'/O 



Weeks school operates each year 



TLENGH 



TLEGTH 



Average time spent in training 
medium per student 
(non-recycled students) 



Average hours per week student 
spends in medium 



RCRATE 



ARCYTM 



ESP 



Recycle rate 



Average time the recycled student 
spends repeating material 



Percentage of excess student 
positions required to provide 
jfor fluctuations in input 



.ClM 



NOTE: All percent values are entered as decimal equivalents.' 



Figure 6. Sample Cost Data on Cost Data Collection Form (continued) 
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Figure 7. Sample of Sumnary Cost Data for Two Delivery System 
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Choose the Cost-Effective Instructional Delivery System or the Mix of 
Systems . The selection of one or a mix of the alternative instructional 
delivery systems and the justification of this choice is based on data 
organized in all three previous steps of the TECEP process. This final 
act of choosing a delivery system, however, cannot be procedural i zed. 
While the low cost solution should be considered a prime candidate, the 
training system designer must still weigh the variations in cost among 
the useful delivery approaches, along with the relevant administrative 
factors that influence the selection of a delivery system irrespective 
of technical solutions. 

Figure 8 provides a sample of this final act of the selection 
process. 
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Analysis of Delivery Systems for Operator Training on the 
Hewlett Packard 61 4A, RF Signal Generator 



TRAINING TASK: 



TRAINING SETTING: 



ALTERNATIVE 
INSTRUCTIONAL 
DELIVERY SYSTEMS: 



ANALYSIS: 



Given: (1) an operational RF signal generator, 
Hewlett Packard 614A, (2) the characteristics of 
the signals to be generated, and (3) the operator's 
checklist, the trainee will operate the equipment; 
i.e., he will describe and then perform each step 
in the equipment turn-on and set-up procedure, 
proceeding through the checklist without error. 

Using an appropriate instructional module, the 
school must train an average of 1190 students per 
year for approximately 10 years. These students will 
use the RF signal generator in laboratory exercises 
imnediately following the completion of this module 
as well as at their duty station at the completion 
of the course. The school house will be open for 
student use 8 hours per day, 5 days per week, 
50 weeks per year. The school uses individualized 
instruction, criterion performance measurement 
techniques, accepts students at any time, and allows 
students to leave the program as soon as they achieve 
criterion performance. A fairly even flow of students 
has been programmed through the training. 

System A : The student uses an operational 
unit of the Hewlett Packard 614A RF Signal Generator 
with a tutor as an instructor and evaluator. The 
instruction is performed in a laboratory setting. 

System B : The student uses a microfiche-based 
self-instruction system with a photo mock-up of the 
Hewlett Packard 614A RF Signal Generator. This 
self-instruction is performed in a carrel. An 
instructor serves as an evali-.dtor. 

The training objective can be achieved using either 
system. Both are individualized approaches to 
instruction and therefore will fit into the individual- 
ized structure of the school. The significant 
differences between the two approaches are summarized 
in the following chart: 



Figure 8. 



erJc 



Sample Report on the Analysis of Proposed 
Instructional Delivery Systems 
37 



TAE6 Report No. 16 





Present 
Cost 


Average 
Discounted 
Cost Per 

Ui auua tc 


Uniform 
Annual 

LOS t 


Acquisition 

Cost for 

Facilities, 

Equipment and 

Instructional 

Material 

Development 


System A 










Operational 

Sv^tpm with 

Tutor 


$460K 


$39 


$71 K 


$7.7K 


System B 










Microfiche 
with Photo 
Mock-up 


$216K 


1 o 








No. of 
Instructors 
(in man- 
years per 


Non- 
Discounted 
Annual 
Instructor 

LOS t 


No. of 
Student 
Positions 
Required 


Average Hours 
Per Graduate 
In Module 


System A 










Operational 
System with 
Tutor 


2.6 


$42K 


2.5 


3 


System B 










Microfiche 
with Photo 
Mock-up 


.3 


$4K 


2.6 


4 



NOT'^: The summary data in this figure appears also in figure 7. 



Figure 8. Sample Report on the Analysis of Proposed 
Instructional Delivery Systems (continued) 
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All economic indicators po-»*" co System A being 
significantly more expensive than System B. The 
three overall cost indicators, the present cost, 
average discounted cost per graduate, and the 
uniform annual cost, all indicate that System A 
will be more than twice the cost of System B. Also, 
the initial acquisition cost of System A is over 
seven times the acquisition cost of System B. 
Instructor support is about 10 times more costly for 
System A than for System B. 

The number of student positions required is 
essentially the same even though System B may 
require one-third more student man-hours than 
System A* The apparent increase in efficiency of 
System A is lost in that only two students a day 
would normally be scheduled intc each student 
position. Tutoring requires almost 10 times more 
instructor man-hours than using an instructor only 
for evaluation. 

The use of System B, the microfiche-based approach, 
involves a highSr level of risk than does the use of 
System A. Tutoring is the traditional solution, 
and a microfiche-based self-study approach is an 
innovative approach with a limited number of 
instances of actual use. However, the significance 
of the risk with System B is low in that the cost 
of trying the microfiche approach with this module 
is low, both in dollars and man-hours. While micro- 
fiche are not presently being used to learn the 
operating procedures for signal generators, the 
technique is being successfully employed in learning 
the checkout and operating procedures for other 
electromechanical devices. 

RECOMMENDATION: Use System B, the microfiche-based system with a 

photo mock-up. The potential dollar savings 
inherent in this approach, when compared with the 
other alternative, provides an adequate basis for 
accepting the low level risk involved in attempting 
to use the innovative microfiche approach. 



Figure 8. Sample Report on the Analysis of Proposed 
Instructional Delivery Systems (continued) 
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TABLE 2. TWELVI TYPES OF LEARNING ALGORITHMS WITH THE 

CHARACTERISTICS OF TRAINING OBJECTIVES THBV SUPPORT 
(See TAEG Report 23 for tctual algorlthMt) 



NAMES OF 
LEARNING 
ALCORlTHffi 


CHARACTERISTICS OF TRAINING OBJECTIVES THAT CAN BE ACHIEVEL WITH 
SPECIFIC ALGORITHMS 

ACTION 

VERBS BEHAVIORAL ATTRIBUTES EXAMPLES 


1. RECALLING 
BODIES OF 
KNOWLEDGE 


Answer 
Define 
Express 

Infora 
Select 


1< Concerns verbal or 
synbollc Icsmlng. 

2* Concerns acquisition and 
long-tera isalntenance of 
knowledge so that It can 
be recalled. 


1. Recalling equipment noxen- 
clature or functions. 

2. Recalling system functions* 
such as the complex rela- 
tions between system input 
and output. 

3. Recalling physical laws, 
such as Ohm*s law. 

4. Recalling specific radio 
frequencies and other 
dlacrete facta. 


2. USING 
VERBAL 
INFORMA- 
TION 


Apply 

Arrange 

Chooae 

Compare 

Determine 


1. Concerns the prsctlcal 
application of 
Infonutlon. 

2. Generally follows the 
Initial learning of 
Inforaatlon throuth the 
use of the (uldellnca 
for Recalling Bodlea 
of Knovled|e. 

3. Linlted uncertainty of 
outcome* 

4. Usually llttlt thought 
of other alternatlvea. 


1. Based on academic knowledge, 
determine which cqulpaent to 
use for a specific real 
world task. 

2. Baaed on an academic knowl- 
edge of the systen, compare 
alternative modes of opera- 
tion of a piece of equipment 
and determine the appropri- 
ate mode for a specific real 
world situation. 

3. Baaed on memorized knowledge 
of radio frequencies, choose 
the correct frequency in a 
specific real world altua- 
tlon. 


3. RULE 
LEARNING 
AND USING 


Choose 

Conclude 

Deduce 

Predict 

Propose 

Select 

Specify 


1. Choosing a course of 
action based on apply- 
ing known rules. 

2. Frequently Involves 
"If ...Then" situations. 

3. The rules are not 
questioned, the decision 
focuaes on whether the 
correct rule Is being 
applied. 


1. Apply the "rules of the 
road " 

2. folve mathematical equations 
(both choosing correct 
equation and the mechanics 
of solving the equation). 

?. Carrying out military 

protocol. 
«. Selection of proper tire 

extingulaher for different 

type flrea, 
5. Uaing correct grammar in 

novel aituations, covered 

by rules. 


4. MAKING 
DECISIONS 


Choose 

Design 

Diagnose 

Develop 

Evaluate 

Forecast 

Fomulate 

Organize 

Select 


1. Choosing a course of 
action when alternatives 
are unspecified or 
unknown, 

2. A successful course of 
action la not readily 
apparent. 

3. The penalties for unsuc- 
cessful courses of 
action are not readily 
apparent. 

4. The relative value of 
possible decisions oust 
be considered - includ- 
ing possible trade-offs. 

5. Frequently involves 
forced decisions ude in 
a abort period of time 
with soft Information. 


1. Choosing frequencies to 
search in an ECM search plan. 

2. Choosing torpedo settings' 
during a torpedo attack. 

3. Threat evaluation and weapon 
assignment. 

4. Choice of tactics in wom- 
bat - wide range of options. 

5. Choosing a diagnostic 
strategy in dealing with a 
malfunction in a complex 
piece of equipment. 

6. Choosing to abort or commie 
oneself to Isnd upon reach- 
ing the critical point in 
the glidcpath. 



ERIC 



41 



TAEG Report No. 16 



TABLE 2. TWELVE TYPES OF LEARNING ALGORITHMS WITH THE CHARACTERISTICS 
OF TRAINING OBJECTIVES THEY SUPPORT (continued) 
(See TAEG Report 23 for Actual Algorlthns) 



^ iHES OF 
1.EARNING 
ALGORITHMS 


CHARACTERISTICS OF TRAINING OBJECTIVES THAT CAN BE ACHIEVED WITH 
SPECIFIC ALCORITIWS 

ACTION 

VERBS BEHAVIORAL ATTRIBUTES EXAMPLES 


5. DETECTING 


Detect 
Dlttlngulsh 

Monitor 


1. Vigilance - detect a few 
cues eabedded In a large 
block of tine* 

2. Low threshold cues; 
signal to noise ratio 
aay be very low; early 
awareness of small cues. 

3. Scan for a wide range of 
cues for a given "target" 
and for different types 
of "targets." 


1. Early sonar detection of a 
submarine target. 

2. Visually detecting the 
periscope of a snorkellng 
submarine during daytime 
operations In a sea state 
of three. 

3. Detect, through a slight 
change In sound, a bearing 
starting to burn out in a 
power generator. 


6. CLASSIFY- 
ING 


Identify 
Recognize 
Differ- 
entiate 
CUtalfy 


1. Pattern recognition ap- 
proach of Identifica- 
tion - not problem 
solvlnfc. 

2. Classification by non- 
verbal characteristics. 

3. Status determination - 
ready to start. 

A. Object to be classified 
can be viewed from aany 
perspectives or In many 
fonu* 


1. Classify a sonar target aa 
"sub" or "non-sub." 

2. Visual classification of 
flying aircraft aa "friend" 
or "enemy" or as an "F-A." 

3. Determining that an Identi- 
fied noise Is a wheel bear- 
ing failure, not a water 
pump failure by rating the 
quality of the noise - not 
by the problem solving 
approach. 


7. IDENTIFY- 
ING 

SYMBOLS 


Identify 
Read 

Transcribe 


1. Involves the recognition 
of symbola. 

2. Symbols to be Identified 
typically are of low 
meanlngfulncss to 
untrained persons. 

3i Identification, not 
Interpretation, la 
emphasized. 

A. Involves storing queues 
of symbolic Information 
and related meanings. 


1. Reading electronic aymbola 
on a schematic drawing* 

2. Identifying map symbols. 

3. Reading and transcribing 
symbols on a tactical 
status board. 

A. Identifying symbols on a 
weather lup. 


8. VOICE 
COMMUNI- 
CATING 

1 

1 


Advise 

Answer 

Cotmunlcate 

Converse 

Direct 

Express 

Instruct 

Interview 

Listed 

Order 

Report 

Speak 

t 
1 
i 
1 


1. Speaking and listening 
In specialized 
languagea. 

2. Often Involves the uac 
of a specific message 
model. Standard 
vocabulary and format. 

3. Also concerns clarity of 
voice, enunciation, 
speed. 

A. Timing of verbalization 
la usually critical 
when to pass Informa- 
tion* 

S. Typically characterized 
by redundancy In terms 
of Information content. 
6i Involves extensive use 
of previously ovcrlcarned 
verbal skills, or over- 
coming overleamed Inter- 
1 fcrlnx patCema. 
1 7. Taak nay be difficult due 
« to preacnce of back^ouod 
nolae. 


1. Officer giving oral orders 
and receiving reporta. 

2. Sonar operator passing oral 
Information over communi- 
cation net. 

3. Instructions by GCA 
operator to pilot In 
landing aircraft. 
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TABLB 2. TWELVE TYPES OF LE*^»N1NC ALCORnHMS WITH THE CHARACTERISTICS 

or TRAININC OBJECTIVES THEY SUPPORT (continued) 
(Se» TAEG Report 23 for ictu*! algorithiu) 



NAMES or 
LEARNING 
ALGORITHMS 


CHARACTERISTICS OF TRAINING OBJECTIVES THAT CAN BE ACHIEVED WITH 
SPECIFIC ALGORITHMS 

ACTION 

VERBS BEHAVIORAL ATTRIBITTES EXAMPLES 


9. RECALLING 
PROCEDURES, 
POSITIONING 
MOVEMENT 


Activate 

Adjuat 

Align 

Aaaemble 

Calibrate 

Diaaaaenble 

Inapect 

Operate 

Service 


1> Concema the chaining or 
aequencing of eventa. 

2. Includea both the cogni- 
tive and Botor aapecta 
of equipment aet-up and 
operating procedurea. 

3. Procedural check liata 
are frequently uaed aa 
job aida. 


1. Recalling equipment 
aaaembly and diaaaaembly 

procedurea. 

2. Recalling the operation 
and check out procedurea 
for a piece of equipment 
(cockpit check liata). 

3. Follovlng equipment turn-on 
procedurea - eaphaaia on 
motor behavior. 


10. STEERING 
AND 

GUIDING - 

CONTINUOUS 

MOVEMENT 


Control 

Guide 

Maneuver 

Regulate 

Steer 

Track 


1. Tracking, dynamic con- 
trol: a perceptual-ttotor 
akill involving contin- 
uoua purauit of a target 
or keeping diala at a 
certain reading tuch aa 
mjintaining conatant 
turn ratea, etc* 

2. Conpcnaatory ax)vciienta 
based on feedback froa 
diaplays* 

3. Skill in tracking 
requirca aaooth auacle 
coordination pattema <- 
lack of overcontrol* 

4. Involvea eatiaating 
changca in poaitiona, 
velocitiea, accclera- 
tiona, etc* 

5. Involvea knowledge of 
display-control 
relationahipa. 


1. Submarine bow and atern 
plane operatora maintaining 
a conatant courae, or 
making change.a in courae pr 
depth. 

2* Tank driver following a 
road* 

3* Sonar operator keeping the 

curaor on a aonar target. 
A. Air-to-air gunnery - target 

tracking. 
5* Aircraft piloting such aa: 
viaually following a 
ground path. 
6. Helaaman holding a courae 

with gyro or magnetic 

compaaa. 


11. PERFORMING 
GROSS MOTOR 
SKILLS 


Cut 
Draft 
Draw 
March 

Mix 
Run 
Sew 

Sharpen 

Splice 

Swia 

Weld 

Write 


1. Perceptual-motor 
behavior-^eaphasia on 
motor* Premium on 
caanual dexterity, occa- 
aionally strength md 
endurance* 

2. Repetitive mechanical 
skill. 

3* S'andardized behavior, 
little rooa for varia- 
tion or innovation. 

A. Autooatic behavior - 
low level of attention 
ia required in akilled 
operator. Kin(»ath^tic 
cuca dominate control of 
behavior. 

5* Fatigue or boredom may 
become a factor when 
skill ia performed over 
an extended period of 
time or at a rapid rate. 

6. Fine tolerancea. 

7. Often a cooponcnt of a 
larger taak. 


1. Uae of hand toola auch aa 
haoaer, aaw, wrench, or 
power toola auch aa lathea 
or grindera. 

2. Running a drill preaa in an 
aaaembly line. 

3. Loading acsmunition into 
artillery piecea or 5" 
guna. 

A. Drafting - uae of drafting 

inatrumcnta. 
5. Painting - house painting 

or preaerving ahip hull, 

etc* 

6« Marching - close order 
drill 
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TABLE 2. TWELVE TYPES OF LEARNIKC ALGORITHMS WITH THE CHARACTERISTICS 
OF TRAINIKC OBJECTIVES THEY SUPPORT (continued) 
(Sec TAEG Report 23 for Actual tlsorlthiii) 



NAMES or 
LEARNING 
ALGORITHMS 


CHARACTERISTICS OF TRAINING OBJECTIVES THAT CAN BE ACHIEVED WITH 
SPECIFIC ALGORITHMS 

ACTION 

VERBS BEHAVIORAL AHRIBUTES EXAMPLES 


12. ATTITUDE 
LEARNING 


Abide 

Accept 

Approve 

Coaply 

Testify 


1. Concerns exhibiting s 
psttern of behsvior 
consistent vlth sn 
attitude or value. 

2. Concema vlllinsness to 
perfom sccordlnt to a 
stsndard ss opposed to 
skill to perfora accord- 
ing to thst standsrd. 
(Note: A person can 

hsvt a high level of skill 
but choose not to perform 
In a skillful manner.) 

3. Concerns integrating or 
orgsnizing a value or 
attitude into a psttern 
of behavior. 


1. Complying vlth known ssfety 
stsndards while performing 
a maintenance procedure on 
a high voltsge supply in a 
radar set. 

2. Conforming to the stsndard 
of keeping one*s bunk ares 
neat and clesn when the 
opportunity exists to do 
otherwise. 

3. Abiding by security regu- 
lations when hsndllng 
classified Inforvation. 

4. Accepting the need to take 
risks when necessary to 
protect the lives of 
tcasnatcs. 

5. Complying with a request 
to repair a malfunctioning 
radio circuit with greater 
than nonal speed when a 
quick response is required. 
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INSTRUCTIONAL DELIVERY SYSTEM SELECTION CHARTS 
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TABLE 3. INSTRUCTIOHAL OaiVERY SYSTEM CHART FOR THE ALGORITHM 



RECALLING BODIES OF KNOWLEDGE 





Direct Ions i 


Alternative Zn»ttuctional Deliv«>ry Syst«M« 




To choosa a dallvary 
systsMi 

1. Place a V" (light 
pancll) In boxes 
reprosantlng crltarla 
(rows) that Must ba net. 


D 
P 
o 
a 


ellvery Approaches 
eralttlng the Application 
f All Learning Guidelines 
nd Algorithm 


Delivery Approaches NOT 
Permitting CoMplt'te 
Application of Learning 
Guidelines and Algorlthn 














(ft 










2. Salact the dallvery 
systaas (coluans) that 
have an "X" In each row 
designated by a 
Thoio arc the candidate 
Vdallvery systeas. 










U M 

•H 3 (A 
> TJ « 


» 41 

U V 
0 H 

0 M 

0 C 
i u t/ 

a, a. 


if 


C 9 

0 0 


u 

■If 


Criteria for 
Selecting 
Instruct lonal 
D<»1 Ivary 
Systeas 






M 
< 

o 


Teaching Machine - 
Branching 


v> 

•H 

» <^ 
c 

U 

I? 0 
•H y 
M t/i 
O 1 

U Vt 
tj »H 
M « 

X « 


1 

1 «/ 

w 

V tl 

h ^ ** 
> n 

V 4> 
M c 

m A c 

U tf M 

^^ c fci 

0 f 0 

Oi, a vi 


0 Mil 

*' ^ 

u < 
m c 

■A U 

9 C » 
N H 1 

** %4 

V 0 V 
JJ u c 
< A. 4 


0 w 
0 « c 

U i> ^ 
T U U 

n b 'J 
d. 

C 0 C 
0 W 4 

*i 3 » 

M U it 

« « M 
H M H 


^ » 

P X 

o 

N 0 

3 V 
^ C 
V) f M 
X ^ 

0 

C » 0 
V * Xi 

T} X X 

C 0 u 
4> 0 0 

it u 

M H 4 


^^) *> 

K U i, 
0 

O f O 
3 V 4 

^ H T) 

1* 0 V 

M a h 


c ^ 
•* u 
*J 0 

o 
1 o 

w u 

MO*' 

if *> /. 

th <J it 

Ti u 
V *)» c 
K 0 
B C H 

m — I* 

U i/ 

^£ w 


StlHulus Crltarla 
























• Visual Hovc'taent 
























Llalted 




X 


X 






X 






X 






Full 




X 








J( 






V 
A 




• Visual Sp«ctru« 
























Pull Color 




X 


X 


X 




X 


X 


X 


X 




• Audio 


























Voice Sound Kanga 




X 


X 






X 


X 




X 






Full Sound Kanqe 












X 










Training Setting Criteria 






















# Individual Tralnoes at rix«d Location 




X 


X 


X 


X 


X 


X 




X 


X 


# Individual Tralneo^ with Siaultancous 
Instructlr^n at Many Lo^'atlon^ 


















X 




• Individual Trainee* wtth Indopfnd<»nt 
Instruction at Any Location 








X 


X 






X 




X 


# Snail Group 
















X 




X 




• Large Group at a 


Slngi*« Location 














X 




X 




• T<»a« Setting 
























ACiiAinistrat Ive Cr Iter la 






















• olte of Cour»ew.*r*» and }}p*»clal Hard- 
ware DevolopM^nt 
























Loca 1 








X 


X 


X 


X 


X 




X 




C-nt ral 




X 


X 


X 


X 


X 




X 


X 


X 


9 Magnitude of Acquisition coot 
























Low 








X 


X 




X 


X 




X 




High 




X 


X 






X 






X 





45 



ERIC 



TAE6 Report No. 16 
TABLE 4. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



USINO VERBAL INFORMATION 





Direct ions s 








Altsrnstivs 


Instructional 


Dslivsry Sy^teMS 




To chooiit a delivsry 
wyst«n( 

1. riace a V Hight 
pencil) in boxss 


Dslivsry Approach** 
Psrnittinq the Application 
of ALL Learning Guidelines 
and Al'^ortthM 


Dslivsry Approaches NOT 
P*rBittin9 Coaplete 
Application of Learnin^J 
Cuidslines and Al«|orithii 




representing criteria 
(row^) that BUSt be vet. 




















crit»ri« for 


2. Select the delivery 
«y»teB9 (coluans) that 
havs an "x* in each row 
dssignatx'd by a V- 
Th*s« ar« th« candidate* 
k dvlivrry 4y«te»>(. 


c 

0 

<J c 

« *c. 

<:. i!' 

T» »« 
** V 

* w 

< c 


c 

4 

A 


» 4 

V c 


4 

« 

■ 'H 

4 V> 
X 


4> 
• 

c 

»< 

0 

t» 
•Ji 
1 

'A 

> 


/ c 
■f 

tr > 

1 

*^ J 

0 J" 
C . if 
I? • 1/5 
4 ki ^ 

O <^ H 

if 

^ 3 M 


o 

0 

H 

A 
4 

4 

C 


c 
c 

4 

A 

O 




Dfl iv«ry 
Sy«tf n9 






< ^ 

O »i 
0 -< « 

V > a: 


« 

4 

k< 

? 
u 


t » 0 
R C >« 

4^4 

w gi ^ 
(T' C 3 
0 4 fl 
H H ^ 

t« a 


T c 

^ >3 

V C 
4 4 
• H 
1* » 


"5 
o 


C C 

0 ^ 
»* ^ ? 

3 C 
H 4 <>1 


0 
*i 
V 

H 


C 

o 




^tiBMlu*^ Criteria 
















































Linitod 




X 






X 






X 


X 






Fun 




Y 
A 












y 

A 


y 

A 




• Visual stjtfTtryim 
























fun col<>r 




X 




X 


X 


X 




X 


X 




• Audio 
























Voice Soynd Range 




X 






X 




X 


X 


X 






Tuil ^ound F(an<je 


















X 




Trjiinin.<) s«ttir<j Crit^ri^ 






















9 InJividuak Trainf<>^H at Tixf'i Location 




X 


X 


X 


X 


X 


X 




X 




• In<livi<lvial Train>»o><« with ln<lrp*rt<a*rit 
IftNtru', t lori at Any Locatio^ 






X 


X 




X 










• "^Ball firo^i 


















X 






• L*r7"* Jrouf/ at 


• ^inqile lo^ji^ion 
















X 






• T^aa ^(Httini 




















X 




A'inini«>trat ive Crit* 


rl^ 






















• Sit* of coyr**war* and! Hard- 
ware Dev^loia^rit 
























toe a 1 






X 


X 




X 


X 


X 


X 






^•ntrsl 




X 


X 


X 


X 


X 


X 








• Ha<7nitud« of Acquisition Cost 
























Low 






X 


X 




X 


X 


X 


X 






>!i<)h 




X 






X 
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TABLE 5. INSTRUCTIONAL DaiVERY SYSTEM CHART FOR THE ALGORITHM 



RULE LEARNING AND USINC 



Dir«ctionat 

To chooa* a d«liv«ry 

1. PUe« a "J" (lifht 
pencil) in box«a 
r«pr«s«ntin9 criC«ri« 
(rowi) that Muit b« avt. 

2. Select th« delivery 
eysteai (eoluans) that 
have an "X" in each row 
deil9nated by a "J', 
These are the candidate 
delivery aysteas. 



CriteriA for 
;i>i^l«ctin-] 
Instructional 
Del ivery 
Systeas 



Alternative Instructional Delivery Systeat 



Delivery Approaches 
Peraitting the Application 
of All Learninf 
Guidelines «nd AWoritha 



4 hi 

C 0 

O w j< 
^00 

4* a o 

m u a 

it m G 

A C m 

o s 



b 4> X 

.f ^ o 

V s o 

^ u A 

^ 41 T^l 

O a C 

u e 9 

*. M s 



Delivery Approaches NOT 
Peraittin? Coaplete 
Application of Learning 
Guidelines «nd Al<]oritha 



Sttaulus Criteria 

• Visual rora 

Pictorial, Plane 
Line Construction! 
Object. Solid 
1 Znvironnent 

• Visual Mov»a«nt 

Liaited 
rail 

• Visual Sp«rctrua 

Cray ScaU 

Color 



• A'jdio 



Voice Sound Ran?* 
Pull Sound *an«* 
Anbiertt Sounds 

*"\ctxl'^ Cue* 

Internal Stiaulua Motion 
Cuea 

Extrrnil Stiauilu* Motion 
Cue* 



X X 



X X 



In«tru<'tlonal >^ftin<j Criteria 

• Individual Trainee at Fixed Location 

• Individual Train*'^ with Ind)*p«ndent 
In-str^jct ion at Any Location 

9 Saall Oroijp 

• Lar?*. ^,roup at a Single Location 



AdninisitratiVf^ criteria 

• «it»" of Codr-^ewar" and $pAcial liard- 
w4re Devel':>|.(»ent 

Loc«l 
C' t.t r«l 

• N^ir.it'jJ*- of Ai |ui%iltlon Co»t 

low 

HUh 



ERIC 
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TABLE 6. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



MAKING DECISIONS 



To choose a dclivtr/ 

1. H«c« 4 V* (IWht 
(••ncil) in box«» 
rt|>r«»cntin9 crittria 
(rows) that Bust b« sat. 

2. SeKct th« >J<>liv«ry 
•ysten* (column*) that 
hava an "X" In *ach row 
4A'9i9natc<! by a V*- 
Tht9n ar« the candidate 



Criti^ria for 
Sel«ct4n9 
Irii*>trwiCtlonal 
Dfl iv.»ry 



Altarnativ* Inatructional Dt'liv^ry SyvCess 



Dtliv«ry Approaches 
r«rnittxn9 tii« Application 
of All Learnxn^ 0ui4elin«9 
and Aljorithn 



3 ** 
■ M 



Delivery Approach*'* NOT 
ramitting Co»fl*t* 
Application of L^ar. .r^ 
Cuidalint* and Al>]iorlltT)N 



3 r 



X 0 



^tlJiulu'^ Criti^ria 

• Vijual Porn 

Alphanun<"riCN 
ri<.toriat, nam 
Ob]«ct« Solid 

• Visual Hov«aicnt 

Still 

F'jiil Hov^-B^r^t 

• AMdiO 

VoiC" sound ftani^ 
Full .>ojrd jPanj*- 



t.xt<-rnal ^tinviti 



Training l^ttin^ Criti^ria 
• Individual Trair.>>'> at Kix^d Locatiofi 



• Ind^p^ndt-nt Train-"'* with Ind*>f *f»d*nt 
Iri<ttruct iof) at Any tocatiOA 



• ^Hall '^roup 

• Tean $et t i 



Adnini^trat ive Crif'ria 

• of CoMrx*>war«> and r^pi^cial Har)- 
war«f Dr^vi»iopn'^nt 

Lo<fal 

C*»\feral 

• Ma>;nitud>> of Ac^uMiCion Cost 

Low 
Hiih 
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TABLE 7. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



DETECTING 



Criteria for 

Selecting 

Instructional 

Delivery 

Systems 



Directions : 

To choose a delivery 
systea: 

1. Place a -7" (light 
pencil) in boxes 

I . 'senting criteria 
(rows) that oust be met. 

2. Select thu delivery 
systems (columns) that 
have an "X" in each row 
designated by a "J", 
These are the candidate 

^clivory systems. 



Stimulus Criteria 

• Full visual Environment 

• r 1 Ambient Sounds 

• External Stimulus Motion Cues 



Training Setting Criteria 

• Individual Trainee at Fixed Location 
(School) 

• Individual Trainee On-the-Job 



Alternative instructional Delivery Systems 



Delivery Approaches 
Permitting the Application 
o£ All Learning Guidelines 
and Algorithm 



m 






H 


u 




3 


0 




c 


o 






0 




V 


9 




V) 


u 








it 


£ 


n 


0 




c 


0 


■H 


H A 






•0 




C 


c 




m 


m 


0 




X 


V V 




ta 


c 


u 


>> 


m 


0 


Vi 










u 


H 




3 




H 


u 


c 




V 


0 


C 


» 


>H 




4J 


•H 


H 


m 


Vi 




u 




i: 








o 


ii 


7 



n o 
c o 

H A 

jC C 
K 

•rt E 
h 

U O 

0 ^ 
4^ O 

1 3 



O 

« o 

H C 

Vi n 



•0 3 0 



U >H 

c o 



Delivery Approaches NOT 
Permitting Complete 
Application of Learning 
Guidelines and Algorithm 



A 4J 

O (0 
►5 N 



<3 

B O 

0 o 



Administrative Criteria 

#Site of Courseware and Special Hard- 
ware Development 

Local 
Central 

#Hagnitude of Acquisition Cost 
Low 
High 
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TABLE 8. IMSTRUCTIOHAL DaiVERY SYSTEM CHART FOR THE ALGORITHM 



CUSSIFYING 



Mrectionsi 

To choos« A delivery 
systea: 

1. PUco * 'J' (light 
pencil) In boxes 
representing criteri* 
(rows) th«t Must be net. 

2, Select the delivery 
systent (columns) that 
h«vo «n "X" in e»ch row 
designated by « "J". 
These *r« the candidate* 
.dt'llvory systens. 



Criteria for 
f (t-Kct in-j 
Instructional 
Dol ivt>ry 
Systf-as 



Alternative Instructional Delivery Systcns 



Delivery Approaches 
Peralttlng the Application 
of All Learning Guidelines 
and Algorithii 



Delivery Approaches NOT 
PC'rnxtting Coor lete 
A|plica»ion of L<rJirrjing 
GuidelxAes and Alg-^ritrtn 



** > 

8 * 



C X 



$tisnulu5 Criteria 

• Vi'iual iora 

Alphanurat-r ic 

rictortal. Piano 

Lint- con,vtruict ion» Plan** 

Ofc)»*ct, ^'olid 

Environment 

• Vi vuil Movt'tnent 

^till 

Limited 

Full 

ExACt *^C4l»- 

Voic»' Sound f.5in'?e 

itjtll r,ound ?!4n<jr 

'^pbunt 5ound:i> 

oth«=-r Tactile Cues 

lrkt»rn>l iiti-^-'jIii* Motion Cu»=»<: 

Lxf»-rnal ^tjnulus Motion Cu»>s 



rruntri)} j:»'tting Orit-^ria 

• Innvi<^jal Traln"^ at a FiX'-d Location 

• InUvid'iiJ Trainee with Ind^p^ndett 
Instruction at Any Location 

• ' " »n '■.roujp 

• Lir-K '"'roup at stngK Location 



Adnjnistr if iv*> Critr rii 

• at.- of cour«,<»war*^ and Sp«"clal Hard- 
rfar'- ti»'V«> Joj ra^nt 

Local 

central 

• Mainit^jd.* of Acq(uisifion co^t 

lov 
Hlg^ 
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TABLE 9. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



IDENTIFYING GRAPHIC SYMBOLS 





Directions : 




Alternative 


Instructional 


Delivery 


systems 




To choose a delivery 


Delivery Approaches 






Delivery Approaches NOT 




system: 


Permitting 


the Application 




Permitting Complete 






of All Learning 


Guidelines 




Application 


of Learning 




1. Place a V" (light 


and A 


Igori 


thm 








Guidelines and Algorithm 




pencil) in boxes 
representing criteria 
























(rows) that nust be 


met. 
























2. select the delivery 








V 
H 


c 














systens (columns) that 










O 
U 














have an "X- in each 


row 




c 




c 


Vi 














designated by a V • 




j: 


>H 


u 


VI 














These are the candidate 


m 


u 
c 


j: 
u 


o 
u 


■H 
V 














k delivery systems. 


■H 

a 


m 

u 


c 
m 


1 


Vi 


a 














n 


B3 


u 


VI 


JZ 


0 














>H 




n 


•H 


41 


O 














•0 


i 




0 




U 














•H 

K 


0 

c 


1 

41 


4: 


) 

n 


n 
m 






u 








3 




X 


41 


41 


•H 






i) 








n 


j: 


i) 






o 






41 










u 


H 












«] 








> 


19 








•H 






OS 




Criteria for 






X 


•0 

0 


0 
;C 


•0 

u 


« 

C 






u 




Selecting 






tj 

C 


a 

Q 


U 

>H 


m 

o 


o 


M 

o 




■H 
41 




Instructional 










V4 


1 


41 


o 




4 




Delivery 






£ 
U 


U ^ 


O 
Wi 


>i n 

•0 41 


•0 


Xi 

41 


u 


B 

0 




systems 




M 
< 


K 
V 


0 

u 


u 


9 n 

41 V 




X 
0 




41 

3 










o 


H 


c 


X 


w H 






O 


< 




Training sotting Criteria 
























• Individual Trainee at a Fixed Location 




X 


X 


X 


X 


X 




X 


X 


X 




• Individual Trainee with Independent 
























Instruction at Any Location 








X 


X 


X 




X 


X 






Adninistrative Criteria 
























^ Site of Courseware and Special Hard- 
























ware Oovolopnent 


























Local 








X 


X 


X 


X 


X 


X 


X 




Central 




X 


X 


X 


X 


X 




X 


X 


X 




• Magnitude of Acquisition Cost 
























Low 








X 


X 


X 


X 


X 


X 


X 




High 




X 


X 
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TABLE 10. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



VOICE COMMUNICAHNG 



Dirtctions : 

To choost A delivery 

1. PUce A 'J' (light 
ptncil) in boxes 
representing criteria 
(rows) thAt Must be «et. 

2. Select the delivery 
systems (coluans) that 
have an "X" in each row 
designated by a "J' , 
These arc the candid«t<tf 
delivery systens. 



Crit<?rta for 
S<»i«cting 
Instructional 
D«f 1 1 vf ry 



Alternative Instructional Delivery Systens 



Delivery Approaches 
Permitting the Application 
of All Learning Guidelines 
and Algorithm 



■H *i W 

> o o 

3 C 

b «> 4 

C N ^ 

M c a 



V 0 

U M Jt 

3 O 

"0 3 0 

U -3 *> 

O >« C M 

h C '5 4? 

*• M s H 



< > 



0 O i 

u X i 
4 

4 a. : 

^ u i 



m o 

3 > 

C 4i 

^ < 



Delivery Approaches NOT 
Pemitting Coaplete 
Application of Learning 
Guidelines and Algorithm 



0 

^ us 



0 O ^A 

w X 

4 4 

fc« ft> >-< 

0 h k< 

A 4 t> 

4 4^ 

^ i 4 

O X 

0* t 15 

4 V 

9 > ** 



3 C 
U ■ 



o « 



Stimulus Crit-fria 

• Visual Fora 

Pictorial, Plane 
Solid Obicct 

• Visual Movi-nfnt 

Still 

Full Mov^>ia«-nt 

• Au<Jto 

Vote*' Souft'J IK'Snge 
ARbi> nt 3our«ds 



Tr.ntninK? ?f>tt»n; critoria 

• Xrxltvidual Triinr**- at ^ Fix.»<J location 

• Indjvidiu^sl Trilnc^• with 1 rkJ.>p«^nd*^nt 
Xn'itruct ior» at Any Location 

• T^'dn s«'t t ir.«; 



Ad"^iri,istr*t I v«? crit.Ti^ 

• JJjt" of Cour *5»»war«' and 
Gp^'cial HardwariTt D<>v^lopm«>nt 

L<»r il 
«"<»ntri 1 

• MmnjiMidi. of A'lui^ition Cost 

Low 
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TABLE n. INSTRUCTIONAL DELIVERY" SYSTEM CHART FOR THE ALGORITHM 



RECAUING PROCEDURES AND POSITIONING MOVEMENT 



Dirtetlonti 
aytt«Ki 

l« riAC* A V Ui9ht 
r«n<:il) In k^xct 
rcf'rcvcntinf criteria 

(rOWl) th^t BU»t k« K«t. 

2. S«l«et the delivery 
syst««t <c«iuiiht) that 
h»v« An "X" in cAch rvw 
4«»ifnit«4 by t V", 
Tlt«»« Arc the cAnJidAt* 
.delivery cyttcB*. 



Crit*riA for 

Stltcting 

InttroctionAl 

&«ltvtry 

$y»t««i 



Co^pl^xity Crit«riA 

• Olfficalt Motor Acts 

• Smooth Motor »«rforBAnc« At 
End of TrAininf 

stiByilui Crit«riA 

• Vi»a«l rora 

AlphA«NuB«r ic 
tictor&af. »lAn« 

obj«ct* s-^lid 

• Vi»UAl MOV«M«nt 

^till 

r^ill Movtavnt 

• Audio 

Voict $o\jftJ R«n4« 

foil So\>Ra RAn')^ 

A«bi*ftt 60jn-1» 

• f>th*r 

TAc<cil* Cu*! 

XntarnAl ^iti»>4ig« xotiOft Cati 



TrAiniA^ Suttinfl Criteria 

• XndkVkdMAl Trakntt At rixtd locAtioft 

• XndividuAl TrAiint« with Znd*p*nd»r.t 
ln«truction At Any tocAtion 

• ^MAll Ot<f>ip 

• lAr9* <iro^tf At $lnylt LocAtion 

• tvAM Slitting 



AdMinictrat iv« •rrlt«rlA 

• SI**- of CouratwAr* And <(»~ia1 HAr S- 
wAr* &nv«»loj.n«r,t 

''••ntraX 

• MAf riit«jd«> of A^'^^jtimt Ion < rt«t 



Alt«rnAtiv« Xnttructiontl Delivery Syttcat 



&«liv«ry ApprOAch«9 
»«rMittin9 th« AppUcAtion 
♦ f AU Lvirnlnf Cuidclinc* 

And Alsjoritha 



X X 



X X 



D«liv«ry ApproAChtt KOT 
rtraittlng C«apl«t« 
AppliCAtlon •f LcArnlnf 
'uld«lin«» And Al^orlthK 
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TABLE 12. INSTRiJCTIOHAL OaiVERY SYSTEM CHART FOR THE ALfiORITHH 



STEERING a GUiDING-CONTINUOUS MOVEMENT 





Directions : 




Alternative Instructional Delivery Systems 




lo choose a delivery 
systemt 

1. Place * V" (light 

percil) in boxes 


Delivery Approaches 
Permitting the Application 
of All Learning Guidulines 
and Algorithm 


Delivery Approaches NOT 
Permitting Complete 
Application of I^earning 
Guidelines and Algorithm 


Criteria fc 
Selecting 
Instructior 
Del ivery 
Systems 


representing criteria 
(rows) that must be met* 

2. Select the delivery 
systems (columns) that 
have an **X'* in each row 
designated by a **^** * 
These are the candidate 
klolivery systems • 

r 

al 


Operational System, Real Environment 
with Instructor and Instructor 
Handbook 


Simulator with Motion Platform and 
Full visual Field, Instructor and 
Instructor Handbook 


Simulator (Without Motion Platform 
and Full Visual Field) Instructor 
and Instructor Handbook 


Procedure Trainer, Instructor and 
Instructor Handoook 


Operational System, Real Environment, 
Without Instructor 




Stimulus Criteria j 
Pull Visual Environment { 




X 


X 






X 




External Stimulus Motion Cues 




X 


X 






X 




Pine Movement Manipulative Acts 




X 


X 


X 




X 




Broad Movement Manipulative Acts 




X 


X 


X 


X 


X 




Training Setting 


Criteria 
















Inai\ Idual 
at a Pixed 


or Team Training 
Location 




X 


X 


X 


X 


X 




Individual or Team Training 
with Independent Instruction 
at Many Locations 




X 








X 




Administrative Criteria 
















Site of Courseware and 
Special Hardware Development 


















Loca ) 




X 








X 






Central 




X 


X 


X 


X 


X 
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TABLE 13. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



PERFORMING GROSS MOTOR SKILLS 



Direction! : 

To choose a delivery 
lyiteai 

1. Place a "7" <light 
pencil) in boxei 
representing criteria 
(rowi) that auit be aet. 

2. Select the delivery 
lyiteai (coluHni) that 
have an "X" in each row 
designated by a **J**, 
These are the candidate 
delivery lysteai. 



Criteria for 
Selecting 
Instructional 
Del ivery 
Systons 




Training Setting Criteria 

• Individual Trainee at a 
Fixed Location 

• Individual Trainee with 
Independent Instruction 
at Many Locations 

• Small Group 

• Team Setting 



Alternative Instructional Delivery Systens 



Delivery Approaches 
Peraitting the Application 
of All Learning Guidelines 
and Algorithm 









c « 






























9 « 




C C 




c « 


A' V 




H U C 




•H M 


Vi U M 


0 


A' •H 4 


« 




0 U 






V 


A' 9 


» 0< « 


n 


« 0<j< 


m 








o 


(f) V 


0 >, H 


U 0 




U 


0 C 4 


M n 


U A 




V 


A «| H 


u c 








^ p, 


(0 0 








c *v 




»J n 


4^ 


iJ 




« 4i 


1 « X 


M 




X *i u 


<« 




O 




n 0 




0 C h 


c 


0 c 


Wi » 0 


C 4i 


O 0 






0 H « 


« M 


■ ii 


« 


■ 




C 


«0 Q. 0 








>i 0 


•H 9 


Q 






A' 1 


C S U 




c s 




•H « 




4J 


•H 0" rt j: 


Q 


U M 


C 




K 0 *I 


-H 


u c 


» 




C C -H 




0 j; M 


0 


M J 


f3 « 






*i *i 


4 


a a 


V C 




9 >H 


C ^ > 


« « 




CI 


H > 


4 a H 





Delivery Approaches NOT 
Peraitting Complete 
Application of Learning 
Guidelines and Algorithm 



C *i C 

n x: 

W -» H 

C M tJ > 

M 0 Wi Wi 

0) 0 >»t 0 

^ 9 4^ 
O" O 

■ O 9 

*i U U 

U hi tH 

•4 M H 
0 * 

-u « c 

i «» c fl 0 

J O -H 

* a t< u 

4 a I _ 

O 4J 4J 

O n 9 Wi 

O" « 

0* m a Pk V 



U A 
0 0 



Adminlstrati vo Criteria 

• Site of Courseware Development 
Local 
Central 
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TABLE 14. INSTRUCTIONAL DELIVERY SYSTEM CHART FOR THE ALGORITHM 



This chart is us«fol in s^l^cting an instructional 
delivery systea for the affective and behavioral 
conponents of attitude learning. For achieving the 
cognition component use instructional deliverv 
systems suggested for recalling bodies of knowledge 



ATTITUDE LEARNING 



Criteria for 

Selecting 

Instructional 

Delivery 

systems 



Directions ; 

To choose a delivery 
system: 

1. Place a "7" (.^ght 
pencil) in boxes 
representing criteria 
(rows) that must be met. 

2. Select the delivery 
systems (column) that 
have an "X" in each row 
designated by a "7". 
These are the candidate 
delivery" systems. 



Alternative Instructional Delivery Systems 



Delivery Approaches 
Permitting the Application 
of All Learning Guidelines 
and Algorithm 



o >4 m 

>5 o w 

-< 0 O 

d 3 H 

c u 

O AJ O 

W TJ 

i> C 3 

«) M (J 

U H 

0 TJ W 

C O 

O «S < 



o m 

«J o 

u c 

U K 

W .-I 

c 



o 

C jQ 



U 0) 

.0 0 »J 

0 *i la 
•a u 

tf il o 



H C 4J 



Delivery Approaches NOT 
Permitting Complete 
Application of Learning 
Guidelines and Algorithm 



Training Setting Criteria 

• Individual Trainee at Fixed Location 

• Individual Trainee with Independent 
Instruction at Many Locations 

• Small Group 

• Team Sotting 



Administrative Criteria 

• Site of Courseware Dovelopnont 

Local 
Central 

• Magnitude of Acquisition Cost 

Low 
High 
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APPENDIX A 

ALTERNATE APPROACH FOR STEP TWO 

Step 2, as presented in section III, is a "by-the-numbers" procedure. 
It is a simple sequence of events for selecting delivery systems, but in 
its simplicity it eliminates the chance for innovation or for a sensitive 
response to special conditions. An alternative approach restores the 
possibility of responding to special conditions. The alternate approach 
contains the following steps: 

First, study the appropriate set of learning guidelines and algorithms 
in TAEG Report 23.^ Modify the algorithms, as required, to accommodate 
the required training tasks. 

Second, list those media characteristics from table 15, Generic 
Characteristics of Training Media, required to carry out the intent of 
the algorithm with the training objectives. As an example, a specific 
training objective matched with an algorithm may require an instructional 
delivery system with the following set of basic characteristics. 

Visual form: 

Visual alphanumeric 
Visual pictorial plane 

Visual Movement: 

Visual still 
Visual Spectrum: 

Color 
Audio: 

Voice sound range 
Trainee Response Modes: 

Multiple choice 



James A. Aagard and Richard Braby, Learning Guidelines and Algorithms 
for Twelve Types of Training Objectives . TAEG Report No. 23. Training 
Analysis and Evaluation Group, Orlando, Florida (manuscript form, to 
be published mid-1975). 
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TABLE 15. GENERIC CHARACTERISTICS OF TRAINING MEDU 



STIMULUS CAPABILITIES 


16. 


Full Sound Range - a quality of sound reproduction 








that containa all the significant elements of the 


Visual Fora 




sound and ia suited to the demanding task of 








sound recognition exercises. 


1. 


Visusl Alphanuasric - vords, nuabers and other 








syvbols presented graphically. 


17. 


Ambient Sounds - a complex sound environment with 








sounds emanating from varioua aourcea and from 


2. 


Visual Pictorial. Plane - a two-dl«enalonal 




varioua direction'', including background noise 




inage, a repreaentation in the fora of • 




snd tssk significsnt sounds. 




photograph or drawing. 










Other 






Visual Line Construction, Plane - a tvo- 








diaenaional figure made of lines, such ss 


18. 


Tsctile Cues - siRnala received through the acnae 




a mathematical curve or graph. 




of touch, including scnsstions rclstcd to texture, 








size or shape. 




Viaual Oblect, Solid " a three-dinenaional imaie 








or reality that ia vicved froa exterior 


19. 


Internal Stimulua Motion Cues - the sensations 




pcrapectives. 




ielt by <i person when he moves his arm, leg. 








fingera, etc. 


5. 


Viaual Environment - A three-dinenaional iiaate 








or reality that ia viewed from inaide. 


20. 


External Stimulua Motion Cuca - the sensationa felt 








by a peraon when he ia moved by some outside force 


Visual MovcBcnC 




in such a way that his body experiences roll, 








pitch, yaw, heave, away and/or aurge. 


6. 


Viaual Still - a atatic viaual field, aa with a 








atill photograph, dravins, or printed page. 


TRAINEE RESPONSE MODES 


7. 


Viaual Liaited Movement •> a basicsUy stscic 


21. 


Covert Reaponse - a reaponae which the trainee 




visusl field with elements that can be made to 




createa in his mind but docs not express in an 




move, aa with an animated transparency or simple 




observable manner. 




psnel with switches tnst move. 






8. 




22. 


Multiple Choice - • reaponae mode in which a 


Visual Full Movement - s visual field In which 




trainee selects a response froa s limited set of 




all elements csn move, aa with a notion pictura. 




responses. 




flight aiaulator, or operational aircraft. 






9. 




23. 


Pre-pro(?rsaned Verbal Performance - a reaponse 


Visual Cyclic Movement - a visusl field frtiich 




node in which a trainee createa a short snswcr 




moves through s fixed sequence and then repeata 




to a question having a limited set of correct 




the aequcnco in a repetitive manner, as with 




snswers. 




a film loop. 










24. 


Free-Style Written Performance - s response mode 


Visual SpccCrua 




in which a trainee writea a response in his own 








words. 


10. 


Black ,ind White - a visual field cosDosed of 








either black or white elemcnta, as with the 


25. 


Decision Indicator - a verbal or perceptual 




printed page or line drawinga. 




motor response in which the trainee indicatea 








that he haa made a divergent type decision. 


11. 


GxssiV Scale - a visual field coi&i>oscd of black. 






white and continuous gradations of gray, aa 


26. 


Voice Performance - a reaponae mode in which a 




with a black and white photograph or 




trainee apeaka, including conversation. 




telcviaion picture. 










27. 


Fine Movement H<inipulative Acts - a response 


12. 


Color - a visual field composed of various 




mode in which a trainee makea dlacrete and 




segments of the visual apectrum, aa with 




small fflovemcnta of dials, switches, keys or 




color televiaion or tootion pictures. 




rtakes serfltive adjustments to instruments. 








Act toay involve use of small instruments. 


Scale 












28. 


Broad Movement Manipulative Acts - s response 


13. 


Exact Scale - actual visusl field or a one-to- 




node in which a trsinee makes large oovcmenta 




one replication of that field as with s full- 




of levera or wherla on large piecea of equip- 




sized roock-up, simulstor, or operational 




nent or by rhe use of hand held tools. 




ayatcQ. 










29. 


TrackinR - a response mode in which a trainee 


14. 


Proportional Scale - a representation of 




continuously controls a conatantly changing 




reality in other than full acale, auch as « 




ayatcm, auch aa ateering an automobile or 




scaled model map or photograph. 




holding a compass bearing in steering a ship. 


Audio 




20. 


Procedural Manipulative Acta - a reaponse mode 








in which a trainee performs the sequence of 


15. 


Voice Sound Ranjie - a liaited Quality of 




atepa in a procedure, auch as in the carrying 




aound which enablea apoken worda to be 




out of the items on the checklist for pre- 




used aa the medium of communicationa, but 




flighting an aircraft or turning on a radar 




not suited to more demanding tasks, such 




ayaten. 




as music or sound recognition exerciaea. 
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TABLE 15. GENERIC CHAKAaERISTICS OF TRAINING MEDIA (continued) 



INFORMATION FEEDBACK LOGIC 



For« of Feedbiek 

31. Intrlntle Feedback - Information tha trainee 
reeeivea froa hia ovn internal aoveMnta or 
froa proprioceptive atiaulation. 

32. Action Feedback - externally diaplayed cuea 
inharent in the taak» including auch forma 
aa inatruaent indicationa and the diaplay 
of anfvera to queationa aa in linear 
pro^raaaed inatruetion. 

33. AuRmented Feedback - inudiate preaentation 
of inforxaation to the trainee on how the 
reaulta of hia perforaance conform to aoaa 
criterion or an objective refarence. 

34. Rfconatruction Feedback - critical analyaia 
or avaluation of trainee performanca^ 
uaually at the coapletion of an excreiac 

or a ai^nificant block of inatruetion. 

Content of Feedback 

35. Correct Reaponae Data - an indication of 
correct reaponae ia provided the trainee 
either inrediately after he reaponda or 
automatically in the event he doea not 
reapond within a apecified tiae. 

36. Score Data - the trainee reeeivea 
quantitative information about hia 
performance (auch aa aaount» percent 
and rata data). 

37. Diagnoatic Data - the trainee ia informed 
of inadequate performance, ita cauae» 

and preacribed reaedial actiona. 

38. Syatea Perfomance Data - the trainee 
obaervea changea in the atate of a 
ayatea aa a conaequence of hia actiona 
in the ayatem. 

Time Schedule for Feedback 

39. Inacdiate - feedback provided in 
continuity with a traincc*a action* 
cither continuoualy aa accrued or at 
the concluaion of each atudent 

ri >ponae. 

40. Fixed - feedback provided to the 
trainee at preacribed timea» auch aa 
at the end of an exerciae or at timed 
intervala. 

Variable - feedback provided to a 
trainee according to a variable 
achedule which aay change aa a 
function of atage of training or 
level of perforaance. Thia includea 
the proviaion for intermittent 
preaentationa to permit probabiliatic 
achedulea of reinforcement. 

EVENT SEQUENCE LOGIC 

Lin e^ar - a fixed aequence of 
inatructional eventa» aa in linear 

programed instruction and motion 
pictures. 



43. Cyclic - a apecial caae of linear aequence in 
which a limited aegaent of a linear program ia 
rapcated continuoualy throughout a period of 
tise» aa with a film loop. 

44. Branching - a aequencing of inatructional eventa 
with tha trainee routed to appropriate advanced 
or reaedial material bated upon hia anawcra to 
diagnostic questions imbedded at intervals in 
the material. 

45. Automated (Machine) Adaptive - an automatic 
sequencing and pacing of aventa dealgned to 
keep a trainee at the threahold level of hia 
ability to learn at all tiaea. 

46. Inatructor Salected Sequence - the ordering of 
eventa by the Inatructor » auch aa in a lecture- 
recitation parlod in the traditional claaarooa 

or In tutoring. 

47. Trainee-Initiated Inquiry - the aelection, 
aequencing and pacing of learning eventa by the 
trainee. 

48. Dynaaic Modalint <- ayatea prograaaing in the 
form of a aimuletlon model which cnablea the 
trainee to exerciae the model snd obaerve the 
correaponding affecta. 

INSTRUaiONAL SETTING 

49. Individual Trainee at Fixed Location - a fixed 
atudy poaition for individualized instruction, 
auch aa In a achool with carrela or CAI 
teralnala. 

50. Individual Tralneea with Sinultaneoua Instruction 
at Many Locationa - any aite that con be used 
with a telecoanunicatlon node of inatruetion, aa 
with acheduled radio or broadcaat televiaion. 

51. Individual Trainee with Independent Instruction 
at Any Location - any aite that can be uaed by 
a atudent for independent atudy as with books 
or progravKd inatruetion texta. 

52. Small Croup - a meeting aite ace^iaaodating up 
to 15 people, enabling aiull grojp dynaaica to 
function; both leaderleaa and leader-directed 
groupa; a as^ll elaaaroon. 

53. Lar^e Croup at Single Location - a nceting aite 
for oore than 15 people, auch aa a large clasarooa 
or audltoriua. 

54. Larxe Groupa at Diaporaed Locationa - two or more 
group aaetlng aitea that can be linked with 
coaounication cquipaent for a cocanon training 
prograa, aa with two-way cloaed circuit TV 
between elaaarooaa at two different achoola. 

55. Team Setting - a ainglc aite that ia equipped to 
enable a group of Individuala to pcrfora aa a 
teaa, aa in a weapon ayatea aimulator or 
operational ayatea. 
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Form of Feedback: 

Action feedback 

Content of Feedback: 

Correct response data 
Score data 

Time Schedule of Feedback: 

Immediate 
Variable 

Event Sequence Logic: 

Branching 
Instructional setting: 

Individual trainee at fixed location. 



Third, review the contents of table 16, Media Pool, and consider 
instructor roles required for the use of these media. Devise combinations 
of media and instructor resources that can carry out the intent of the 
algorithm with the training objectives. List and describe these different 
combinations as alternative instructional delivery systems. 

The Media Pool is a list of 89 types of instructonal media. The 
list contains a broad range of types of media, including media In various 
stages of development, from operational forms to those under development, 
and some that have yet to reach the prototype or pilot program stage. 
It is organized into seven categories. The categories are printed 
material, audio-only systems, visual-only systems, audio-visual systems, 
CAI/CMI, simulated and operational systems, and special or nonstandard 
items. Within each category, the media are listed alphabetically. 
While this is not an exhaustive list of types of instructional media, it 
contains the major forms being used or being considered for use in 
military training systems. 

Fourth, reject those that fail the practicality test, described in 
Step 2 of the primary procedure. 

Conceiving instructional delivery systems using this alternative 
approach is a highly creative task requiring expert knowledge of the 
subject matter, the guidelines, algorithms, and potential delivery 
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systems, as well as an awareness of the local conditions at the training 
site. It requires a high level of professionalism on the part of the 
training systems design team. 
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TABLE 16. MEDIA POOL 



PRINT MATERIALS 

CASE STUDY FOLDER - A folder of detailed background information on a 
problem requiring a decision or plan of action; to be read by the 
traii.ee prior to his (1) making a decision on how to resolve the 
issue and (2) participating in a critique on various solutions. 
Various forms of folders are used in support of such methods of 
instruction as the Case Study , Incident and In-Basket methods of 
management and leadership training. 

FLASH CARDS - A set of cards designed to be used by an instructor in 
front of a group of trainees to drill the group in the recall of 
memory type information. 

PRINTED MATERIALS - HANDOUTS - Handouts are a class of printed materials 
issued to a student for his use and retention to augment regular 
instructional materials. They are usually instructor prepared, 
machine copied materials of one or two pages highlighting specific 
topics or updating existing materials. 

PRINTED MATERIALS - PERFORMANCE AIDS - Performance aids are a class of 
printed materials that aid in job performance by providing data 
that should not be committed to memory. They include checklist 
routines, conve^'sion tables, equipment test tolerance matrices and 
the like. 

PRINTED MATERIALS - REFERENCE BOOKS - Reference books are a class of 
printed materials used to identify certain facts or for background 
information such as dictionaries, encyclopedias or technical 
publications. 

PRINTED MATERIALS - REFERENCE CHARTS - Reference charts are a class of 
prinoed material pictorial ly displaying data used to identify 
certain facts or for background information. Included are data 
charts, schematic diagrams, topographical maps and the like. 

PRINTED MATERIALS - SELF-SCORING EXERCISES - Self-scoring materials 
include exercises and quizzes used in conjunction with standard 
curriculum, or programmed instruction. The class includes electro- 
graphic or mark sense materials scored by keys or computer, punch 
mark and other mechanical score indicating equipments, chemically 
scored materials, etc., that have the capability of providing near 
immediate student feedback without the use of prolonged scoring 
procedures. 
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TABLE 16. MEDIA POOL (continued) 



DIAL ACCESS INFORMATION RETRIEVAL SYSTEM - RANDOM AUDIO - Dial access 
ImI?!?"?* ^S") ^^^ri^val is an electronic system for distributing 

lo?a?iin"J{L'trf'^^ l?'*''!^^' '"^ P^^S^^""^ "^'""^ stored in a 
location remote from where they are dialed and received. Random 

audio means that audio materials are retrievable at any time by 
!jMS!nS"'"^^i triggering a tape duplicating machine that makes a 
.student copy from a master tape within the library. 

DIAL ACCESS INFORMATION RETRIEVAL SYSTEM - SCHEDULED AUDIO - Scheduled 
audio means that audio materials may be dialed at any time, but 
??Sgress!'°^''^'" '"'"'^^"^"^ "^^^^ ™st join the program in 

LANGUAGE LABORATORY - AUDIO. ACTIVE - COMPARE MODE - An audio presenta- 
tiona device that distributes audio information via a control 
^nn!ni /-^ f*""*!"* stations equipped with headsets, microphone for 
console/instructor-student inter-communication, and a tape recorder 
nl."J'h.rrL'"J''''* "^'^^ instructional material. Rewind and ' 

Sr L'o^Sed a? co'nsole'°"'"- '''' "^"^"^^^^^ 

LANGUAGE LABORATORY - AUDIO PASSIVE MODE - An audio presentational 

device that distributes audio information from a control console to 
student stations equipped with headsets. Audio source may be a 
phonograph record, a taped recording, or a motion picture sound 



PHYSIOLOGICAL TRAINER (HOSTILE ENVIRONMENT) AUDITORY - A training device 
\ Zllnf '° Pi'" controlled stress on the human hearing system 
I through use of a physiologically and/or psychologically adverse 
sound environment, to enable a trainee to learn to function in this 
adverse environment. "n^'iun m tnis 

'^'^^^JmhIo" ; "^^^^l^ P'''^"r' ^"^^"^ system consisting of a broadcast 
studio, transmitting station, and student radio receivers 
The system uses designated AM/FM frequency bands for information 
"crsnsmi ss 1 on • 

RADIO SYSTEM WITH RESPONDERS - A multi-channel two-way radio communication 
system that operates within UHF or VHF-FM frequency bands limiting 
broadcast ranges. Network may be open or use encoding/decoding 
techniques or responders for individual channel privacy. 



63 



TAEG Report No. 16 
TABLE 16, MEDIA POOL (continued) 



TELEPHONE CONFERENCE SYSTEM - A telephone system with switching matrix 
capability that allows multiple station two-way audio communication 
at two or more remote locations. 

VISUAL ONLY SYSTEMS 



FILMSTRIP PROJECTION SYSTEM - A single frame projector or attachment 
thereto that will accept a films trip format and project the film 
images upon a viewing screen. See: Sound Filmstrip Projection 
System. 

MICROFORM WITH INFORMATION MAPPING - Microimagery, such as microfilm, 
used as a medium of instruction with the additional requirement 
that each block of information be clearly identified as introduction, 
overview, test, review questions, index and other discrete titles, 
and that each type of information be positioned in a standard 
location within the medium format. 

MICROFORM WITH INFORMATION MAPPING AND ADJUNCT EQUIPMENT - The theoretical 
configuration of a training system to support individualized 
instruction composed of microimagery in an information map format, 
a microform reader, and a piece of auxiliary equipment, such as a 
mock-up, which is the subject of the instruction. 

MOCK-UPS, PANELS, AND DEMONSTRATORS - DYNAMIC - A visual training aid 
that allows an instructor to demonstrate manipulative principle, 
movement in time or space, steps of a procedure, linear effect 
within systems or changes in condition of equipment or systems 
through one or more operating phases. 

MODELS AND STATIC MOCK-UPS - SMALL SCALE - A three-dimensional training 
aid built to scale and representing operati-onal equipment. It may 
be a solid or cutaway model capable of disassembly by which spatial 
and/or sequential relationships are represented. Also included are 
layout models, recognition model sets, and terrain or topographical 
models. 

MOCK-UPS, PANELS AND DEMONSTRATORS - STATIC - A training aid "used to 
demonstrate relative shape, size, composition or function of an 
object or system by a visual -cognitive process performed by the 
trainee. Such non-moving, real or "scaled" aids include cutaway 
models, diagrams, blow-apart hardware displays, etc. 

SLIDE PROJECTOR SYSTEM - 2" X 2" - A class of single frame picture pro- 
jectors that will accept a standard 2" X 2" slide and project the 
contained image upon a viewing screen. 
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PRINTED MATERIAL - WORKBOOK - Workbooks are a class of printed material 
used to augment or replace instructional texts by providing a mix 
of text information and practice exercises within a single book or 
manual . 

PRINTED MATERIAL - TEXTBOOK - Textbooks are a class of printed material 
dealing with a subject of study, intended for use at a specified 
level of instruction and used as a principal source of organized 
information. 

PROGRAMMED TEXT - BRANCHING - A printed text containing frames of infor- 
mation and multiple choice questions concerning the information, 
organized in such a way that the trainee's choice of response 
directs him to remedial frames or advanced material, as appropriate. 
The material is carefully sequenced, tested and revised to ensure 
that a specific student population will achieve stated behavioral 
objectives with a predetermined level of success. 

PROGRAMMED TEXT - BRANCHING WITH ADJUNCT MATERIAL/EQUIPMENT - A fom of 
program in which additional materials such as drawings, catalogues, or 
equipment are used with the regular branching programmed text. 

PROGRAMMED TEXT - LINEAR - A printed text containing a fixed sequence of 
small frames of information usually in the form of questions requiring 
the trainee to construct a simple written response, which is immedi- 
ately evaluated. The material is carefully sequenced, tested, and 
revised to ensure that a specific student population will achieve 
stated behavioral objectives with a predetermined level of success. 

PROGRAMMED TEXT - LINEAR WITH ADJUNCT MATERIAL/EQUIPMENT - A fom of 
program in which additional material such as drawings, catalogues, 
or equipment are used with the regular linear programmed text. 

STUDY CARD SETS - A deck or decks of cards designed to present training 
information to an individual student. 

AUDIO ONLY SYSTEMS 



AUDIO DISC PLAYBACK SYSTEM - An audio system that uses a record player 
and sound recorded on a disc (record) that may be played back by a 
listener. 

AUDIO TAPE SYSTEM - An audio system that uses a tape recorder/reproducer 
to record sound on magnetic tape that may be played back upon request 
by a listener. 
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SIMULATION - PAPER - The representation of selected dynamic character- 
istics of a system through the use of charts, tables, static photo- 
graphs, drawings, and lists of performance characteristics under 
specified conditions. This information is presented in such a way 
that the trainee can study the initial performance of the system, 
change inputs to or elements within the system and note changes in 
the performance of the system. 

TEACHING MACHINE - LINEAR, STILL VISUAL - An individualized instruction 
system composed of a fixed linear sequence of small step programmed 
instruction frames (still) and a manually controlled device to 
display the information. 

TEACHING MACHINE - BRANCHING, STILL VISUAL - An individual ized, instruc- 
tion system composed of large step multiple choice progranmed 
instruction frames (still) and a manually controlled device to 
select, sequence and display program frames in an order dependent 
upon the trainee's last response. 

AUDIO-VISUAL SYSTEMS 

AUDIO TAPE WITH PRINTED MATERIAL - An audio system that uses a tape 
recorder/reproducer to record sound on magnetic tape 'that may be 
played back upon request. Printed materials such as texts, work- 
sheets, PI, schematics, test materials, etc., used with audio tapes 
offer a variety of training applications. 

CARREL - AV EQUIPPED - A small enclosure or alcove incorporating a desk 
used for individual studies, supplied with audio and visual materials 
and supporting equipment. 

CARREL - LABORATORY - A small enclosure or alcove incorporating a desk, 

to be used by one or two trainees and equipped with a set of special 

tools and material for carrying out a hands-on learning event. It 
may include audio-visual systems. 

DIAL ACCESS INFORMATION RETRIEVAL SYSTEM - SCHEDULED AUDIO/VIDEO - Dial 
access information retrieval is an electronic system for distributing 
audio and visual materials and programs which are stored in a loca- 
tion remote from where they are dialed and received. Scheduled 
audio/video means that presentations are retrievable at any time 
except that once a program has begun, subsequent users must join 
the program in progress. 
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FILMSTRIP PROJECTION SYSTEM WITH AUDIO - A sound filmstrip projector 
represents a family of audio-visual devices using single frame 
visual filmstrips with sound on magnetic tape or records. Visuals 
and sound may be manually or automatically synchronized. Commercial 
equipment options include front or rear screen projection, remote 
and stop action capability, and cartridge loading models. 

FILMSTRIP PROJECTION SYSTEM WITH AUDIO AND ADJUNCT EQUIPMENT - A system 
for presenting information via a filmstrip projector and synchronized 
audio tape and special equipment that is the subject of study. The 
use of adjunct equipment with the AV media provides capability 
for a variety of "hands-on" training tasks to be performed. 

INSTRUCTIONAL KIT WITH INSTRUCTOR - A teaching kit designed for specific 
subject area instructional support. Kit allows the instructor to 
use a varied or multi-level teaching approach to instruction by 
in^^luding appropriate visual aids, audio tapes, models, charts, 
demonstrators, reference and test materials. 

INSTRUCTIONAL KITS FOR TRAINEES - A modular package of materials 

for students that contains all materials required for a segment of 
instruction. Kit may contain programmed instruction, audio-visual 
materials, tools, materials, typical samples, reference materials 
and testing materials as appropriate. 

MOTION PICTURE PROJECTION SYSTEM - COMMERCIAL, 16MM AND SUPER 8MM FILMS - 
Amotion picture projection system implying the use of professionally 
prepared 16mm or S-8mm sound motion picture films for training. 
Appropriate 16mm or S-8mm projector and projection screen are 
included. 

MOTION PICTURE PROJECTION SYSTEM - LOW BUDGET 16MM AND SUPER 8MM FILMS - 
A motion picture projection system implying the use of locally 
produced sound motion picture films for training. Such films are 
acceptable for training, but often lack the professional quality of 
commercial films. Appropriate 16mm or S-8mm projector and pro- 
jection screen are included. 

MICROFORM WITH INFORMATION MAPPING, AND AUDIO - The theoretical configu- 
ration of a training system to support individualized instruction 
composed of microimagery in an information map format, a microform 
reader, an audio tape in a cassette and an audio cassette playback 
unit. 
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OVERHEAD PROJECTION SYSTEM WITH INSTRUCTOR - A system consisting of a 
horizontal stage projector designed to use a vertical throw for 
focusing an enlarged transparency image upon a projection screen. 
An operator is normally required to change the transparency and 
furnish verbal commentary. 

SOUND SLIDE PROJECTION SYSTEM - A system for presenting information by 
means of an audio tape and a series of synchronized projected 
visual slides. 

STUDENT RESPONSE SYSTEM - AV SUPPORTED - A student feedback response 
system using programmed audio and/or visual presentations. It 
consists of four major components: control console with response 
readouts, student responders, audio visual devices, and a programmer. 
Options include paper tape readouts and computer interface terminals. 

TEACHING MACHINE - BRANCHING, STILL VISUAL WITH AUDIO - An individualized 
instruction system composed of large step multiple choice programmed 
instruction frames (still) with synchronized sound and a manually 
controlled device to select, sequence and display program frames in 
an order dependent upon the trainee* s last response. 

TEACHING MACHINE - BRANCHING, STILL AND MOTION VISUAL WITH AUDIO - An 
individualized instruction system composed of large step multiple 
choice programmed instruction frames (still and motion) with synchro- 
nized sound and a manually controlled device to select, sequence 
and display program frames in an order dependent upon the trainee's 
last response. 

TEACHING MACHINE - BRANCHING, WITH ADJUNCT EQUIPMENT - An individualized 
instruction system composed of large step multiple choice programmed 
instruction frames (still or motion with or without audio) with a 
manually controlled device to select sequence and display program 
frames in an order dependent upon the trainee's last response. 
Associated with this equipment is a second piece of equipment, such 
as a mock-up, which is the subject of instruction and is operated 
according to instructions from the basic teaching machine* 

TEACHING MACHINE - LINEAR, STILL VISUAL WITH AUDIO - An individualized 
instruction system composed of a fixed linear sequence of small 
step programmed instruction frames (still and motion) with synchro- 
nized audio, and a manually controlled device to display the audio 
and visual information. 
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TELECONFERENCE SYSTEM - A telecommunication system that allows audio and 
visual two-way communication between two or more remote locations. 

TELEVISION - CABLE (CATV) - A hybrid CCTV system offering selective, 
multip e channel, encoded programming to cable network patrons. A 
typical system consists of a signal receiving antenna system for 
the master station and relay of amplified signal channels via area 
substations to system subscribers. Programming may also be generated 
and transmitted between substations offering multiple options for 
conference or training. Programs are encoded for privacy and control 
of viewing audience. 

TELEVISION - CARTRIDGE (CTV) - A cartridge television system (CTV) 

consists of packaged video tape programs, video recorder, playback 
and display units, and control equipment offering high selectivity 
and availability for individualized programming. Program cartridges 
may be prerecorded, locally produced, or recorded off-the-air. 

TELEVISION - CLOSED CIRCUIT (CCTV) WITHOUT FEEDBACK - CCTV without 

feedback is an electronic transmission system for images and sound 
using a coaxial cable distribution system. System design includes 
one or more studios or control rooms, a signal distribution center, 
and signal distribution cables terminating in reception areas 
equipped with receiver/monitors. Off air, live or video taped 
programs may be used. 

TELEVISION - CCTV WITH FEEDBACK - CCTV with feedback is the transmission 
of a live presentation with audio feedback via microphone or tele- 
phone in each receiving classroom. Live instructor is required in 
student-instructor-CCTV loop to activate the feedback mode. 

TELEVISION- NON-MAGNETIC VIDEO DISC SYSTEM - An experimental form of 
television, similar in function to cartridge television, in which 
the program is encoded on a thin plastic disc, distributed to users 
where it is rotated at high revolutions per minute on a player which 
reads the data and sends program signals into the antenna terminals 
of a standard color television receiver. Random access capability. 

TELEVISION - OPEN BROADCAST - Open broadcast television is the electronic 
transmission of images with accompanying sound from a single channel 
VHF and UHF station and shorter range multiple channel 2500 MHZ 
systems. 
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TELEVISION - PORTABLE VIDEO TAPE SYSTtM - A low cost video tape recording 
and playback system which is self-contained and portable. Typical 
systems consist of one or two mobile vidicon cameras, a small scan 
video tape recorder and a monitor receiver. Immediate area 
programming and open broadcast reception and recording is standard. 

TELEVISION - VIDEO DISC WITH ADJUNCT EQUIPMENT - A theoretical con- 
figuration of a video disc system in which random access capabilities 
are used by a trainee in retrieving step-by-step procedures and 
diagnostic routines as an aid in performing these operations on a 
piece of equipment. 

CAI/CMI 

COMPUTER ASSISTED INSTRUCTION (CAI) - A form of individualized instruction 
that employs digital computer technology to manage and display 
information to a student, accept student responses, provide knowl- 
edge of results, and select subsequent learning event. 

COMPUTER ASSISTED INSTRUCTION - PLATO IV BASIC CONFIGURATION - An 

individualized computer based teaching system being developed by 
the University of Illinois at Urbana-Champaign, and includes up to 
4096 terminals, a communication network, a central computer and the 
author language TUTOR. 

COMPUTER ASSISTED INSTRUCTION - PLATO IV, BASIC CONFIGURATION AND AUDIO - 
System includes basic configuration of PLATO IV plus a random access 
audio playback system. 

COMPUTER ASSISTED INSTRUCTION - PLATO IV, BASIC CONFIGURATION WITH ADJUNCT 
EQUIPMENT - Includes the basic terminal with externally connected 
auxiliary equipment. 

COMPUTER ASSISTED INSTRUCTION - PLATO IV BASIC CONFIGURATION WITH ADJUNCT 
EQUIPMENT AND AUDIO - The basic terminal with externally connected 

auxiliary equipment including a random access audio playback system. 

COMPUTER ASSISTED INSTRUCTION (CAI/CMI) TICCIT - A CAI system designed 
by Mitre Corporation which allows. the student to manage his own 
instruction. 

COMPUTER MANAGED INSTRUCTION (CMI) - A student management system in 
which a computer receives information about student achievement 
from terminals on- or off-line and directs the student to a sequence 
of off-line learning modules suited to the student's style of 
learning and level of achievement. 
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SIMULATED AND OPERATIONAL SYSTEMS 



COMPUTER SIMULATION - ON-LINE - A trainee station equipped with a 

computer terminal in which the trainee operates in direct interface 
with the computer as part of the program loop. By his inputs, the 
trainee determines his allowable performance parameters and discerns 
the effect of his inputs upon the system being simulated. 

COMPUTER SIMULATION - OFF-LINE - A trainee station equipped with a 

computer terminal enabling a trainee to select a computer simulation 
program, enter his own variables (batch processing) and run the 
simulation to determine the performance of the simulated system 
under a variety of conditions. 

GAME - COMPUTER SUPPORTED SIMULATION - Any contest, governed by rules, 
between teams or individuals, where the contest is a dynamic model 
of some real system, and a computer is used in performing some of 
the calculations necessary for the operation of the model as in 
computer supported war gaming. 

GAME - MANUAL SIMULATION - Any contest between teams or individual 

players, governed by rules, where the contest is a dynamic model of 
some real system, and is played without the aid of a computer. 

LOGIC TRAINERS - A class of trainers that synthetically allow electronic, 
mechanical, fluid or gaseous conceptual system logic training 
without the use of actual hardware. 

GAME - COMPUTER SIMULATION, SOLITAIRE, WITH VISUAL DISPLAY - Any contest, 
governed by rules, between a single player and a computer with 
visual attachments where the contest is a dynamic model of some 
real world system or event. 

OPERATIONAL EQUIPMENT WITH MANUALS - A unit of operational equipment 

being used for instructional or training purposes with its supporting 
technical documentation such as operator's guides, maintenance 
manuals and parts lists. May be an electronic black box, rifle, or 
truck. 

OPERATIONAL SYSTEM - REAL ENVIRONMENT - An operational system used for 
training such as an aircraft, ship or track vehicle. Part task, 
full task, sub-team, team or multi-team training may be conducted 
in conjunction with or independent of normal operations. 
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OPERATIONAL SYSTEM - SYNTHETICALLY STIMULATED - An operational system 
that is used for training by interfacing input equipments in the 
form of tapes, black boxes, or computers. Such input equipments 
present programmed data to the operational system allowing it to 
be used for training or evaluative purposes. May be used for part 
task, full task, sub-team, multi-team training or combinations 
thereof. 

PHYSIOLOGICAL TRAINER (HOSTILE ENVIRONMENT) VISUAL - A training device 
designed to place controlled stress on the human visual system, 
through the use of physiologically and/or psychologically adverse 
or low threshold visual signals, to enable a trainee to learn to 
function in this adverse environment. 

PHYSIOLOGICAL TRAINER (HOSTILE ENVIRONMENT) SURFACE AND INTERNAL SENSES - 
A broad category of training devices designed to provide the 
cutaneous, kinesthetic and olfactory sensors with physiologically 
and/or psychologically adverse signals, to enable a trainee to 
function in adverse pressure, temperature, pain or disorientating 
motion environments. 

PROCEDURE TRAINER - Training hardware designed for basic training, 

familiarization or transition type procedure training for normal, 
alternate and emergency operation of operational hardware. Trainer 
systems respond with a lesser degree of fidelity of performance 
than is required for simulators. May be used for various combinations 
of part task, full task, sub-team, team or multi-team training. 

PROCEDURE TRAINER - ADJUNCT DISPLAYS AND LOGIC - Training hardware 
designed for basic training, familiarization or transition type 
procedure training for normal, alternate and emergency operation 
of operational hardware. Trainer systems respond appropriately 
to trainee inputs but-to a lesser degree of fidelity of performance 
than is required for simulators. May be used for various combinations 
of part task, full task, sub-team, team or multi-team training. 
Adjunct displays and logics may include scoring attachments, 
adaptive control, automatic demonstrations, enhanced displays, 
automated briefing and debriefing capability, automatic coaching, 
remedial exercise prescriptions or follow-on assignments. 

SIMULATOR - Training hardware that is designed specifically for training 
purposes to simulate operational equipment/systems or portions 
thereof, and which simulates the operational environment in a 
training situation. When operated, it becomes a dynamic model of 
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the appearance and performance of selected aspects of the opera- 
tional equipment/ system. May be designed for part task, full task, 
sub-team, team, multi-team training or combinations thereof. 

SIMULATOR - ADJUNCT DISPLAYS AND LOGIC - Training hardware that is 

designed specifically for training purposes to simulate operational 
equipment/ systems or portions thereof, and which simulates the 
operational environment in a training i,ituation. When operated, 
it becomes a dynamic model of the appearance and performance of 
selected aspects of the operational equipment/ system. May be 
designed for part task, full task, sub-team, team, multi-team 
training or combinations thereof. Adjunct displays and logics 
may include scoring attachments, adaptive control, automatic 
demonstrations, enhanced displays, automated briefing and debriefing 
capability, automatic coaching, remedial exercise prescriptions 
or follow-on assignments. 

SPECIAL AND NON-STANDARD ITEMS 



AUTOMATIC RATERS - INFORMAL TRAINING - A class of electromechanical 
response rating devices used primarily for informal refresher 
type training. Typically, a gaming approach is used to offer 
multiple choice type questions to the trainee. Immediate feedback 
upon answer choice selection is given in the form of right, wrong, 
or item score as well as cumulative score. 

CARREL - DRY - A small enclosure or alcove incorporating a desk, used 

for individual studies, without audio-visual or laboratory equipment. 

CLASSROOM - TRADITIONAL - A classroom designed and equipped for an 
instructor to lecture, lead group discussions, conduct paper and 
pencil tests and use instructor controlled audio-visual aids. 

DO-IT-YOURSELF KITS - A type of instructional kit containing instructions 
and materials for fabricating a usable product. Such a kit offers 
practical "hands-on" training following theoretical training. 

GAME - MANUAL NON-SIMULATION - Any contest between teams of individual 
players, governed by rules, where the contest is not a dynamic model 
of some real system, and is played without the aid of a computer. 

SPECIMEN SETS - An instructional kit containing samples of similar items, 
liquids or materials that may be tested or evaluated for identifi- 
cation, quality or type. 
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APPENDIX B 

COST MODEL: DISCUSSION, ASSUMPTIONS AND LIMITATIONS 

An economic analysis is a critical step in the design of training 
systems. A rational choice of an instructional delivery system cannot 
be based upon training effectiveness without regard to cost and vice 
versa. In order to facilitate the economic analysis of instructional 
systems, a cost model has been constructed. The model is simply a 
computational algorithm for determining both the cost of the components 
and the total instructional delivery system. 

An economic analysis requires that alternatives be identified and 
associated resources specified. These determinations must be made prior 
to the use of the cost model and constitute the input data for the 
model. The TECEP approach outlined above provides a systematic procedure 
for the identification of feasible training systems and associated 
resource requirements. After alternatives have been identified and 
their resource requirements specified they must be "costed" and time 
phased. The most common method of costing is to place dollar values on 
the resources These values can be time phased, discounted and summed 
to represent the present cost of each alternative. 

The assuiFiptions and objectives underlying the comparative costing 
of proposed media sets determines which resources are relevant and how 
these resources are valued. The interpretation of the output of the 
cost muael is dependent upon these assumptions and objectives. For 
certain objectives the outputs have only relative meaning while for 
other applications the outputs could have absolute meaning. 

When the objective of the analysis is to select the most efficient 
alternative from among specified set, all of which are capable of 
meeting the training objectives, then the resources common to all alterna- 
tives can be factored out and ignored in the analysis. When the objective 
is to determine the total absolute long-run cost of training, then all 
resources used for training must be included and evaluated at their 
opportunity cost. When the objective is to determine the bud^'^t require- 
ments to implement and operate a system, then the cost of resources 
which must be acquired plus the current costs of operation are the 
relevant costs. 

In the use of the following cost model, the objectives of the 
analysis must be clearly spe^'.fied and resources Identified and priced 
accordingly. A meaningful economic analysis requires that alternatives 
be available, one of which may be the status quo. By roaking explicit 
all of the alternatives and their resource requirements, the analysis 
can often be areatly simplified. Resources which are common to all 
alternatives and difficult to evaluate can be factored out of the 
analysis. 
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Resources which are factored out are, nevertheless, a part of the 
total long-run cost of training. If the decision to undertake training 
is contingent upon the benefits to be acquired versus total training 
costs, then these resource ,iUSt be evaluated and the total cost weighed 
against the benefits accruing from the training. 

Most military tasks have become so sophisticated that the need for 
training is axiomatic. Often the pertinent question is how best to do 
the training and not whether or not to do the training. !hen the 
dp.cision is already made to undertake the training to achieve a particular 
proficiency level then the benefits of any particular alternative over 
another can be measured with respect to the next most efficient alter- 
native. Relative or incremental costing of alternatives provides 
sufficient information for selection of the more efficient alternatives. 

It is anticipated that many users of the TECEP approach and the 
cost model will be administrators at the operational level. These 
individuals most often encounter problems of how best to provide a given 
level and quantity of training. They seldom have an opportunity to 
control these variables. Administrators at this level are most often 
faced with cost minimization problems and are primarily interested in 
planning their training system to most efficiently accomplish their 
training goals. They often have little need to determine the value or 
worth of training and, hence, have little need to compute a benefit-cost 
ratio. 

While the emphasis of the TECEP approach is on cost minimization 
(fixed output levels) there will be requirements for analysis in which 
benefits fluctuate in response to training approaches. The evaluation 
of differential benefits accruing from different training approaches is 
a complex problem and one which has been beyond the objectives of this 
model. While the cost model can be used to evaluate the resources 
required for various training approaches, it does not, nor was it intended 
to, provide a method of assessing differential benefits or effects of 
alternative training appv^oaches. 

The basic output of the cost mod^^ is the present value (cost) of 
each alternative. Additional arithmetical computations are presented. 
The latter include the total and average annual cost per student position, 
the average cost per graduate and a distribution of the incidence of 
costs over the life of the alternative being evaluated. 

For most applications of the model, the analysts will be required 
to access multiple data sources. Past records of operational units 
provide one valuable data source. Personnel data published by NAVPERS, 
and other similar types of data can be used for estimates of personnel 
costs. While the model requires rather detailed breakdown of certain 
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data, the model can be used to advantage even when many of these data 
are not highly reliable. However, data reliability must be recognized 
in the interpretation of results. 

There are numerous limitations in the use of the model. First, and 
perhaps most significant, the model is not capable of identifying or 
selecting (from among the feasible set) the most efficient media. The 
model dcas not utilize any optimization criteria for ascertaining 
effectiveness or efficiency. Its use is limited to a cost determination 
of proposed alternatives (media sets) and only through an iterative use 
of the model could one hope to move toward more efficient solutions. 
Furthermore, the model is not designed to predict or foreca<:t thp total 
cost of a system for which a planner must budget resources. Its primary 
purpose is to aid in selecting the .most efficient instructional medium. 

Second, the model is constructed upon the assumption that for any 
specified planning period there will be some resources which must be 
used as they exist and others which can be varied to accommodate various 
training numbers and levels. However, there is both an absolute limit 
and an efficient limit to the amount of variable resources which can be 
expanded against a fixed set of resources and one must be cognizant of 
these limitations in the use of the model. 

A basic computational unit for which many of the variable costs are 
entered in the model is the "student position. "10 The number of student 
positions required, and hence the variable resources, are computed as a 
function of the training requirements. The training requirements are 
exogenously determined and reflect both numbers trained and course 
characteristics. 

Changes in educational technology which have the effect of reducing 
the time required in the media may result in the need for fewer student 
positions and lower numbers of students in training to fulfill training 
requirements. These cost savings would be reflected in the model. The 
Impact of introducing educational technology which has no effect on the 
resource requirements or time spent in training cannot be evaluated with 
this cost model. The model is not designed to evaluate the effects of 
introducing technology in which the impact occurs entirely on the benefit 
side. 



A student position may be a carrel and related instructional material, 
a classroom position and related equipment, a flight simulator, or it 
might be uniquely defined in terms of the system being analyzed. 
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Third, the model assumes all variable cost functions are linear—an 
assumption that may not be tenable for specific training situations. 

Fourth, the model does not provide any means for evaluation of 
secondary, or spillover, effects of alternative training approaches 
These effects are implicitly assumed to be constant (or equal) for 
alternatives considered. If such effects do in fact exist, they must be 
evaluated outside the model. A general model cannot be defined in 
sufficient detail ,to cover all possible contingencies. These contingenci 
may require the user to exercise judgment in his interpretation of input 
variables. The important consideration is that all relevant costs be 
included and that data are entered in the input variables in a manner 
which avoids double counting. 

The user may often find it convenient to redefine certain variables 
in order to reduce the complexity of the input data for specific applica- 
tions. Such changes can be made by identifying the relevant functional 
relationships in the FORTRAN program and making changes in these relation 
ships where necessary. 

If the analyst is willing to make certain assumptions about the 
structure of the cost data at various points throughout the model, then 
a number of the input variables are not relevant and can be entered as 
zero. For example, if the instructional material is developed prior to 
implementation and no further development is undertaken during the 
planning period then the variable concerning the dollars required for 
instructional material development is zero for all years in the planning 
period. Similarly, if it can be assumed that the instructional material 
has no remaining value at the end of the planning period, then the 
variable concerning the remaining value of instructional materials is 
equal to zero. A willingness to eliminate many of these factors by 
assumption would enable the analysts to reduce the complexity of the 
input data. 

An effort was made in constructing the model to gain as much flexi- 
bility as possible, yet not at the expense of eliminating the model 
usefulness for analysis of less complex problems. 



Secondary effects ar*5 those effects which occur outside the influence 
of the decision-making unit. Therefore, the decision maker does not 
normally consider the impact of secondary effects when making his 
decision. However, from a societal viewpoint these effects may be 
extremely important. An example of a secondary effect, and one not 
normally considered in evaluating military training, is the worth of 
the training to the individual in preparing him for a civilian 
occupation. 
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The input variables are classified into seven classes as follows: 
(1) facilities, (2) equipment, (3) instructional material development, 
(4) personnel, (5) students, (6) supplies, and (7) miscellaneous. A 
definition of each variable follows: 



1. Facilities 



FACOST 



LOFFA 
CPSQFT(I) 



SQFTIN 
SQFTST 
SQFTAM 

2 Equipment 
EQCISP 



LOFEQl 
CAQSP(I) 



Total costs of facilities acquisition 
and refurbishing which are necessary 
for implementation. 

Expected years of life of FACOST assets. 

The annual cost of operation and maintenance 
of facilities per square foot (includes 
operation, maintenance, janitorial service, 
utilities, etc.). Include the annual 
opportunity costs of facilities where applicable. 

Total square feet required for each instructor. 

Total square feet required per student pos'Ition. 

Total square feet required for administrative 
overhead. 



The cost of equipment necessary for implementa- 
tion (that which is not dependent on the number 
of student positions). Do not include equipment 
which is uniquely associated with student 
positions (i.e., costs included in variable 
EQIMPC). 

The expected years of life of equipment included 
in EQCISP. 

Total cost of equipment to be acquired in each 
year of planning period following implementation. 
Include cost of equipment which represents 
expansion or addition to the program plus 
replacement costs for that equipment included 
in EQCISP. 

LOFEQ(I) The expected years of life of equipment which 

has been included in CAQSP(I). 
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OMFEQ(I) 



EQIMPC 



LOFEQ 
COPMT(I) 



Total annual operation and maintenance cost of 
fixed equipment; i.e., the operation and mainte- 
nance cost of equipment not uniquely related to 
student positions. O&M costs of equipment 
included in variable EQCISP and CAQSP(I). 

The cost of equipment (per student position) 
which must be acquired for implementation. Do 
not include equipment which is not uniquely 
related to student positions (i.e., do not 
include equipment costs included in variable 
EQCISP). 

The expected years of life of student position 
equipment; i.e., equipment included in EQIMPC. 

Annual operation, maintenance, and replacement 
costs of equipment associated with each student 
position in each year of the planning period; 
i.e., the O&M costs of equipment included in 
variable EQIMPC and the replacement costs of 
any student position related equipment. 

The percentage of planned operating time the 
student position equipment is nonfunctional 
because of unplanned contingencies; i.e., 
equipment failure, weather, etc. (percentage of 
down time equals one minus the percentage 
availability). 

3. Instructional Material Development 

UIMD The percentage of time spent in the training 

medium (for the nonrecycled student) for which 
unique hours of instructional material must be 
developed. 

UIMDYR(I) The number of unique hours of new instructional 
material to be developed in each year of the 
planning period. (The model assumes tha: any 
materiel developed and reflected in this variable 
is unique to the course and will be fully 
depreciated at the end of the planning period.) 
This variable does not include any updating of 
original course material . 



TSPOSD 
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UPDATE 



EVIM 
CIMD 

Personnel 

INTSPO 

SALINR 

Supplies 
SUPPLY 

Students 
6RAD(I) 

STUDSL 
STCSTl 

STCST2 

Miscellaneous 



Update factor for instructional material • 
Percentage of the original development of 
instructional material expended each year to 
maintain the courseware. 

The percentage of the original development cost 
of the instructional material which remains at 
the end of the planning period* 

Average cost of developing the master copy for 
one hour of instruction (i»e», the per unit 
instructional material development costs). 



Instructor-to-student position ratio. 

Average annual salary and benefits 
for one instructor. 



Average cost of expendable supplies per student 
while in the training medium. 



The number of students who must be trained for 
each year of the planning period; i.e., the 
number who must complete the program and graduate. 

Average annual salary and benefits for one 
student. 

Average student travel costs to and from school. 
Do not include any travel done, as part of the 
course. 

Average student travel costs which are incurred 
as part of the course. Do not include any 
costs to and from school. 



The number of years in the planning period. 
(In setting the planning period, guidance can 
be found in SECNAVINST 7000 J 4A, pages 7 & 8.) 
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ARATE The attrition rate. The percentage of 

students who enroll in the program but never 
complete the training. 

DRATE The discount rate (10 percent according to 

DoD Instruction 7041.3). 

WSCHOP The time in weeks the student position is 

available per year. 

TLENGH The average time in weeks spent in the training 

medium for the nonrecycled student. 

TLEGTH The average hours per week the student spends 

in the medium. 

RCRATE Recycle rate equals the percentage of students 

enrolling in the training who will repeat some 
part of the program. 

ARCYTM Average recycle time in weeks equals the 

average amount of time a student spends in 
repeating any and all parts of the course. 

ESP The percentage of student positions above the 

computed number which are to be acquired to 
provide for fluctuations in student inputs 
through the system. 

The following variables are computed by the model from the above 
input data: 



1 



2. 



Facil ities 
TSQFT 

FCOST(I) 

Equipment 
NSPR(I) 



Total square feet of facilities required: 

TSQFT=(SQFTST)(PSP)+(INTSPO)(PSP)(SQFTIN)+SQFTAM. 

Total cost of facilities for each year of 
the planning period: 

FCOST( I )= (TSQFT ) (CPSQFT( I ) ) . 



Number of student positions required for the 
system: 
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NSPR( I )= ( (SMWRRC( I )+STUDMW( I ) )/ (WSCHOP)/ (1 -TSOPSD) . 

MNSP Mean number of student positions for planning 

period: 

N 

MNSP= 2lNSPR{r)/N. 
1=1 

PSP Planned number of student positions: 

PSP=MNSP+ (ESP) (MNSP). 

EAQCI Equipment acquisition costs necessary for 

implementation: 

EAQCI=(EQIMPC){PSP)+{EQCISP). 

TAEQC{I) Total annual operation, maintenance and equipment 

acquisition costs for each year of the planning 
period: 

TAEQC ( I ) = { CAQSP ( I )+ ( COPMT ( I ) ) (P SP )+OMFEQ ( I ) . 

E3 Annual depreciation of student position equip- 

ment: 

E3 = (EQIMPC){PSP)/LOFEQ. 

R Internal computed variable indicating the years 

of life remaining in equipment at end of plan- 
ning period. 

RVEQ Remaining value of student position equipment 

at end of planning period: 

RVF.Q={R)(E3). 

RVEQ2 Remaining value of equipment purchased in each 

year of planning period {- for all 
(LOFEQ{I) -N)2 0): 

N 

RVEQ2=£(L0FEQ{I)-N) * {CAQSP{I)/LOFEQ{I)). 
1=1 
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RVEQ3 



Remaining value of equipment purchased for 
implementation (-for all (LOFEQl-N)^ 0): 



RVEQ3 = (LOFEQl-N) * EQCISP/LOFEQl . 
Instructional Material 



ACIMD 



CUIMD(I) 



AIMMC(I) 



RVIM 



Personnel 
RINSTR 



CINSTR(I) 



Students 
STUD(I) 



Instructional material development costs for 
implementation: 

ACIMD=(CIMD) (UIMD) (TLEGTH) (TLENGH) . 

Total cost of developing instructional material 
in each year of planning period: 

CUIMD(I)=(CIMD)(UIMDYR(I)). 

Maintenance costs of instructional material for 
each year of planning period: 

AIMfC(I )=CUIMD( I )+(ACIMD) (UPDATE) . 

Remaining value of instructional material at 
end of planning period: 

RVIM=(ACIMD)(EVIM). 



Number of instructors required: 
RINSTR=(INTSPO)(PSP). 

Total costs of salary and benefits for all 
instructors for each year of planning period: 



CINSTR(I)=(SALINR)(RINSTR). 



Student inputs necessary in each year to provide 
the required number of graduates: 

STUD(I)=GRAD(I)/(1'.ARATE). 



ERIC 



84 



TAE6 Report No. 16 



AASIN 



STUDMW(I) 



SMWRRC(I) 

AOB(I) 

AAOB 



TRAVEL 

SSALRY(I) 

6. Supplies 
SUPPY(I) 



ERIC 



Average annual student inputs required to provide 
the number of graduates specified in each year: 

N 

AASIN=2lSTUD(l)/N^ 
1=1 

Total time required in training for all students 
in each year of planning period to train the 
required number of students (to specified 
objectives) utilizing the media set under 
consideration (exclude recycle time): 

STUDMW(I)=(TLENGH)(STUD(I))(1-.5(ARATE))- 

Total time required for recycling for all 
students in each year of planning period: 

SMWRRC(I)=(RCRATE)(STUD(I))(ARCYTM). 

Average number of students on board for each 
year: 

AOB(I)=(SMWRRC(I)+STUDMW(I))/WSCHOP, 

Mean number of students on board for entire 
planning period: 

N 

AA0B=2I AOB(I)/N. 
1=1 

Total annual travel costs for all students: 

TRAVEL=(AASIN)(STCST1)+(STCST2)(AASIN) 
(1-0*5 ARATE). 

Total costs of student, salary and benefits for 
all students for each year of planning period: 

SSALRY( I )= ( (SMWRRC ( I )+STUDMW( I ) ) /52 ) (STUDSL ) . 



Total cost of student supplies for each year 
in planning period: 

SUPPY(I)=(STUD(I))(SUPPLY), 
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Miscellaneous 
UDACST(I) 



RVAS 



RVALUE 



CINT 



ANCSP 



ADCSP 



Total nondiscounted costs for each year 
in planning period: 

UDACST(I)=FCOST(I)+TAEQC{I)+AIMMC(l) 
+CINSTR(I)+SUPPY(I) 
+SSALRY(I)+TRAVEL. 

Total nondiscounted cost of alternative:" 

N 

H4=2iUDACST(I)+FAC0ST+EAQCI+ACIMD 

M 

- RVAS/Cl+DRATE)"^. 

Remaining value of equipment and instructional 
material at end of planning period: 

RVAS=RVEQ+RVIM+RVFA 

Present value (cost) of alternative: 

N 

PVALUe=2I ((UCACST(I)(2+DRATE))A 
1=1 , 

( 2 ( 1 +DRAT E ) IFACQST+EAQC I+AC IMdI 
-|}^VAS/(1.0+DR/rrE)f'J 

Average discounted costs per student position: 

C3=PVALUE/PSP 

Initial system acquisition costs for 
facilities, equipment, and instructional 
material development: 

CINT=FACOST+EQACI+ACIMD. 

Average annual nondiscounted costs 
per student position. 

ANCSP=H4/(N)(PSP) 

Average annual discounted costs per 
student position: 

ADCSP=PVALUE/(N)(PSP) 
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Initial system acquisition costs for 
facilities, equipment, and instructional 
material development per student position? 

ACSP=CINT/PSP. 



UAC 



Uniform annual costs: 




1=1 
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APPENDIX C 

FORTRAN PROGRAM OF COST MODEL 

The purpose of this appendix is to supply the necessary information 
for the use of the FORTRAN IV Cost Model program. This information 
includes a FORTRAN IV Program Listing, a sample data set and a sample 
run. The data collection sheets which define the program's input variables 
are presented as attachment 1 following this appendix. 

The data are entered into the computer using an "F" format. All 
fields are eight columns wide. This format allows the data to be easily 
keypunched directly from the data collection sheets. A sample set of 
data cards is shown in the data deck listing fallowing the program 
listing. Table 17 defines the fields on the first group of data cards. 
Each numeric field must contain a decimal point or else it will be 
interpreted as having two digits to the right of the decimal point. 

Several output options are available to the user of the cost model 
program. The user may select all of the printouts shown in figures 7, 9, 
and 10, or he may choose any combination thereof. A "1" punched in the 
appropriate column of card one selects the desired printout. If the 
user desires these tables, he must supply the appropriate cards to 
define the variable portions of the tables. Figure 7 requires five 
cards per delivery system media to define the righthand side of the 
table. The user must provide a card to define the top row of figure 10 
as well as the cards necessary to define the righthand column of the 
table. Each table can contain up to 15 rows. The data deck listing 
shows the cards used to generate the tables in this document. 

Figure 7 always displays the same eight output variables. Note 
that the rows of numbers for this table are printed in the same sequence 
as they are calculated. Therefore, the row identification label cards 
must be in the same order. Figure 10 allows the user to select one of 
20 output variables and display the value of this variable for up to 
eight categories of training, such as procedure following or decision 
making computed on up to 120 previous runs. .A particular run's position 
in the table is determined by the numbers on the Run ID card. For 
example, the "2" and "6" on the Run ID card for Example 2 specifies that 
this run is to occupy row 2, column 6 of the table. The variable to be 
displayed in figure 10 is selected by punching the appropriate number on 
a title card. The output variables are considered to be numbered from 
1 to 20 as they appear on the printout shown in figure 9. For example. 
Average Annual Student Input is variable number 1, while Nondiscounted 
Cost of Alternative is variable number 4. Table 18 defines the card 
columns of the cards used to generate figure 10. These cards are the 
last group of cards shown in the data deck listing. The subroutine that 
prints figure 10 will continue to read title and variable selection 
cards until an end of file is encountered. 
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TABLE 17. CARD AND COLUMN DEFINITIONS (CARDS 1-6) 
FOR COST MODEL INPUT 



Card 1 






Col umn 


1- =1 ■ 


- Print all input and output variables 


Col umn 


2- =2 ' 

tm Cm 


- Print tahlp chnwn in "fiaiivpi 7 


Col umn 

V w 1 Mini 1 


3- =1 ■ 


- Print tahlp chnwn in ■fiaiivp 10 
ri JUL Luu 1 c ofiuffii III 1 i^uic lu 


Card 2 






Col umns 


1-72 - 


Up to 72 alphanumeric characters 


Col umns 


73-76 - 


Media number 


Cnl umn^ 

\J \J 1 Ullll lO 


77-80 - 


ucai II II ly uatcyui jr iiuiuuci 


Card 3 






Cnl umn^ 


1-80 - 


Uy OU u 1 pilullUlllCi UliaiuULCio 


Card 4 






Columns 


1-8 - 


FACOST 


II 


Q-l fi - 
y 1 Q — 


1 OFFA 
LUr in 


11 


17-9A - 


<;nFTTN 
oi^r 1 in 


II 


c.0"Oc. - 


cnFT^T 

oijr 1 o 1 


II 




^flFTAM 

o^r 1 ni'j 


II 


AT -Aft - 

*T 1 *tO 




II 


AQ-^fi - 


1 OFFDl 


II 


C7»fiA - 
ut OH 


FflTMPr 


It 




1 OFFn 


II 


73-80 - 


TSPOSD 


Card 5 






Columns 


1-8 - 


UIMD 


II 


9-16 - 


UPDATE 


II 


17-24 - 


EVIM 


II 


25-32 - 


CIMD 


II 


33-40 - 


INTSPO 


II 


41-48 - 


SALINR 


II 


49-56 - 


SUPPLY 


II 


57-64 - 


STUDSL 


II 


65-72 - 


STCSTl 


II 


73-80 - 


STCST2 
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TABLE 17. CARD AND COLUMN DEFINITIONS (CARDS 6-10) 
FOR COST MODEL INPUT (continued) 



Card 6 

Columns 1-8 - N 

9-16 - ARATE 
17-24 - DRATE 
25-32 - WSCHOP 
33-40 - TLENGH 
41-48 - TLEGTH 
49-56 - RCRATE 
57-64 - ARCYTM 
65-72 - ESP 
73-80 - 



Card 7* 

Columns 1-8 - 
9-16 - 



73-80 - 

Card 8* 

Columns 1-8 - 
9-16 - 



73-80 - 

Card 9* 

Columns 1-8 - 
9-16 - 



73-80 - 

Card 10* 
Columns 1-8 - 
9-16 - 



73-80 - 



CPSQFT(l) Year 1 

CPSQFT(2) Year 2 

* • 

* * 

CPSQFT(IO) Year 10 

CAQSP(l) Year 1 

CAQSP(2) Year 2 

* * 

CAQSP(IO) Year 10 

LOFEQ(l) Year 1 

L0FEQ(2) Year 2 

LOFEQ(IO) Year 10 

COPMT(l) Year 1 

C0PMT(2) Year 2 

COPMTdO) Year 10 



* A separate card is required for each ten values or fraction thereof. 
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TABLE 17. CARD AND COLUMN DEFINITIONS (CARDS 11-13) 
FOR COST MODEL INPUT (continued) 



Card 11* 
Col umns 1 -8 - 
9-16 - 

• 


OMFEQ(l) 
0MFEQ(2) 


Year 1 
Year 2 


• 

73-80 - 


• 

OMFEQ(IO) 


• 

Year 10 


Card 12* 
Columns 1-8 - 
9-16 - 

• 


GRAD(l) 
GRAD(2) 

• 


Year 1 
Year 2 

• 


• 

73-80 - 


• 

GRAD(IO) 


• 

Year 10 


Card 13* 
Columns 1-8 - 
9-16 - 

* 


UIMDYR(l) 
UIMDYR(2) 

• 


Year 1 
Year 2 

• 


• 

73-80 - 


• 

UIMDYR(IO) 


• 

Year 10 



* A separate card is required for each ten values or fraction thereof. 
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TABLE 18. CARDS FOR GENERATING FIGURE 10 



Lara 1 ■ 


■ Column headings 




1 irrmc 

Lo 1 UHins 


1 "O 


- Heading for table column 1 


II 


0 

y- ID 


_ tl II II 


tl 2 


it 


M OA 


II II II 


tt q 


II 


25-32 


II II It 


" 4 


II 


33-40 


n n II 


" 5 


II 


41-48 


^ II It II 


" 6 


II 


49-56 


tl II II 


" 7 


n 


57-64 


It II II 


" a 


II 


73-74 


- Number of row label 


cards 


Card 2 


- Row 


labels* 




Col umns 


1-16 


- Label for row 1 




II 


17-32 


- " " " 2 




11 


33-48 


^ II II tt 2 




II 


49-64 


« II II II ^ 




II 


65-80 


« II " II g 




Card 3 


- Title and variable selection card 


Col umns 


1-76 


- Title of table 




II 


77-78 


- Variable selection number (1-20) 


It 


79-80 


- The number of rows to be printed 



* A label card is necessary for every five rows or fraction thereof. 
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Figure 10. Sample Simmary. Cost Data by Category of Training 
and Cost Factor 
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A FORTRAN IV (VER SA3) SnURCc Cl^TING» 04/10/75 PAGE 0001 

I PROGRAM DTEOOl 

3 C * PoOr^r^iM - T^CPPT VERSION I 

4 C * P'^OfiRAMMtR • BILL PARRISH 
•5 C * OAT? 12/2/7A 

6 C * , 

9 CHH MSPR.LOFb^ 00000750 

10 riMcNSIQN STl'C"W(3^),SMwPKr.(30)>NSPR(30)KUIMD(3^) 00000800 

11 PlnrNSlON ALPMAr(2'^),UPHA?(?0)>KtY(3) ouuuuoul 

12 INTf,GEf< R 

13 CU^^"aN/I^iVAR/0SA'^(^C)KP^0PT(3O)>CnP^.T(3e)>CAQSpl3<^)/UIKDYR^30)i^M 
lA lPEO(3C)>RLOFFw(3r) ' ^ 

15 PEAL ^IOCGRD>^'»^.5P;^T<^Pn 

16 CO"»!ON' STU0(30)>FC-ST(30)/TAFQr (?0)>AIf^.MC(30)/ClMSTR(30)^SUPPY'(3O) 

17 1/S<;ALRY(30)>"OAC'.T(3^).T(:>0)>NUM(30)>A08(30) 00001500 

19 ^CM^'.0•^^ /DVAR/ ^AM^ > AAaB>HVAL0F>H4>CUN0CCRDK3^cA0CbFAC0ST> 

2A l^CI;lD>CI^iT>R"cr>RVTM>RI^STP>M^^SP>TSQFT>AMCSP>AOC^p;ACSP^UAC 

21 C0^^-^^' /TABLP/ TnATAU5>P) 

22 C 

23 C ^ET^RMir^E OE^lREn PRjMTQfjf 
2A C 

25 ^ PEAG(5> 14>FN*'^»<>9«) (VEY( !)> I5i;3) 

26 00 1 I«1>15 

27 r>Q I J«l>8 
2^ ro I K='.>20 

29 1 y(J>J;;<)=0, 

30 MfCMi^aO 

^ 00001690 

32 C READ ir^PUT DATA 00001700 

^ 00001710 

3A 2fto 3EAD(5>13>EN'>»999) ( At PH AI( I) > t » 1> I S ) >MED> tC 

35 PCA0(5>12) (AIPHA2M)>I»1>?0) 00002200 

36 ^EA'M5>5) FACO«;TiRi 0FFA>«:0FT1N;S0FTST>SQFTAM^E0CTSP^RL0FQUE0ImpCj 

37 UDFEQ>TSPQSC 

38 PFAD(5>5) UI^U/UPD'T^>FVIN>CIM0> INTSPQ^SAL INR/SupPCY^STUOSL>STCSTI 
3*5 1>STCST2 

40 PEAO(5.5) RM>ARATe,D«^ATE>W.SCHOP>TLFNGH>TLEGTH,RCRATE^ARCYTM>ESP 

42 PEAD(5>5) (CPSCFT(I)>1»1>N) 

43 PEnM5>5) (CAQ'JPdwr.l^N) 

44 PEAD(5>5) <^LOFEe»( I 

45 " PEAD(5>5) (CnP?'T( 1), Icl/^3) 

46 READ(5/5) (OmFFQ M ) > T ) 

47 PEAnC5/5) (GPAr(t)^ i.i^N) 
4« »EAD(5/5) (UTM0YH(T)/I»1>M) 

49 C 

50 C PRPGRAH INITIALIZATPN 



00002850 
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A FORTRAN IV (Vtft S43) SDURCF flSTINGI OT^OOl PROGRAM 0«/IO/75 PACE 0002 



51 


C 






00002950 


52 










33 






MUM ( I ) 5 I 




54 






AASIN 30,0 




55 






**N^P "C^O 




56 






AAnS "OtO 


00003350 


57 






PVALUE »0.0 




58 






G2 =OfO 




59 






MOCCRO =OtO 




60 










61 


C 






00003650 


6? 


C 








63 


C 






00003750 


64 






AC ti"-tO»CIMO*UIMO*tL^=GTH*TL£'^GH 




65 






00 300 




66 






STMr>(I) D GRAD(I)/d.O-A''ATE) 




67 






AASIN -AASIN + Sr\J^( I ) 




66 






AA^IN »AASIN/U 




69 






TRAVEL ■ASSIN*STCSTI +AA« I^'♦STCST2* ( I • 0-0 , 5*ARA TP ) 




70 






00 310 I»l/N 




71 






STiiQHWd) ■TLbMGW * ^TUO(I) *( 1 .0-0,5*ARATE ) 




72 






SMWRRC(I) 5RCRATF ft STUOd) ♦ ARCYTM 




73 






^•SPR( !)■( (SM>*'R»C'< n+<;TUOMM( 1 ) ) /WSCHtlP ) / ( I gO-TSPQ^Oi 


00004700 


74 






AO'^(I) ■ (SMWRRC"nS+STUD'^v\(I))/wSCHOP 


'50004750 


75 






AAf^B » AAOB + A0R( I ) 


00004760 


76 




3in 


^^NSRas ^^NSP + I'^^SPPd) 


C0004800 


77 






MNSP « 




78 






AADB » AAOB/^^ 


00004950 


79 






PSP sJ^MSP +E.^P*H^'S^ 




80 






TSOFT sPSP*(^QPT^T + IMTSFO* SCFTIf^)+ SQFTAM 




31 






PA'^C! "EQlMPr, * oS» * EQCISP 




62 






00 340 I«IiM 




93 






FCnST(n= TS^'^T « '•PSQFT(i) 




84 






TAPOC(I)= PSP * COOMT(I)+ CAOSPin+ OMFEQU) 




85 






CUIMD(^cCI^"n ♦ la^OYRd) 




66 






FA = UPDATE * ACIM'-^ 




87 






AlMMCd)»COl^*iJd) + «=4 




88 






PJNJSTR = nT<:P"^ *pcp 




89 






CIMSTR(I) ■Pfi^^^Ti^ * <JALr'K 




90 






SUPPYd) cSTon(!)« «;uPPLY 




91 






SSALRY(I) »( (S»«WRRrd)4. STUOV.fd ) )/52.0)* STUQSl 




92 






"DACST(I) =FCu5Td) + TAFQCII) + AIM^Xd) + CjNSTRd) + SUPPY(l) 




93 






1«^SALRY(I) + TKAVev. 




94 






PVALUF«PVALUP *('<U'^A'*STn)*(?,n+ORATE) )/l2.0*(K^+ QRATE)**!)) 




95 






02 «G2 + GRAr>(l) 




96 






^'PrGRH 3 MDCGRn *u-ArST|n 




97 






F3 = (EQIi^PC * P^Pi/'.U^c^ 




99 






T = \ 




99 






•^7= LOJ-'EQ 




100 






1 = 1 + 1 
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A FORTRAN !v (VER S^3) SnuaCP I'lSTIN'iJ DTPOni PROGRAM 0^/10/75 PAGE 0003 



,01 PaM7*N 

,02 IF 'R.GE^O) GU TC 601 

.03 M7«i*M7 

.0<> GO TO 400 

,05 401 RVFQ « R* E3 

,06 RVFQ2«0» 

,07 t)0 30 I-l/N 

,08 ILOFEQbRLDFEOU) 

.09 IF(IL':'r-EQ»LE,N) r,0 TO 30 

,10 AMftP»CAQSP(l(/l«LnFPQ(I> 

.11 RV6Q2«RVEQ2+ (ILOFrQ^N) * ANDP 

.12 30 CONTINUE 

,13 PVFA=»Oi 

,14 LOFFA»RLOFFA 

,15 IF(L0FFA,IE,V) Gn TO 35 

,16 PFVA=»(LOFFA-K')*(FAr.o<T/LnFFA) 

,17 35 PVPQ3«0, 

,18 LOPEQURLOFQl 

,19 IFdOFEQULE.N) GO TO 36 

,20 ANOPl^EQCISP/LOFPOi 

,21 PVFQ3 = (LOFEqi-w)*A^<0Pl 

,22 36 PVPQ«RVEQ+ RVC02+ ^VPQS 

,23 BVIM « ACIMO » EVI" 

,24 RVAS « RVEQ+ RVIM+OVFA 

,25 PVALUE « PVALUP -C^V^S/ ( 1 .0+DRATE ) **N) +FACOST +CAOCI +ACIMO 

26 . CI « PVALUE/r,2 

27 W4 « NOCGRO-(RVAS/(r,0*0''ATE)**N)+ FACOST +EAQCI +ACIMO 

28 N'OCGRD «H4/G2 

29 C3» PVALUE/PSP 

30 ANCSP«H4/(PSP*M) 

31 AOCSP«PVALUE/(PSP*^') 

32 riNT « FACOST * EA^.CI * AClMO 

33 ACSP « CINT/PSo 
,34 no 40 

,35 40 ORAT«ORaT+ ((2»0*0'iATE)/(2»0*((1.0+0RATE)**I))) 

,36 UAC» PVALUE/OKAT 

,37 no 750 J»bN 

38 750 T(J)« TRAVEL 

,39 !F(KEY(l)iNE.n GO 7^^ 752 

,40 C PRINT INPUT DATA 

41 WR!TE(6/30) 

42 WR!TE(6/10) (ALPHAi ( ! )/ I«l>20) 00010900 

43 WRTTE(6/10) ( ALPWA? ( f I«l>20) OOOllOOO 

44 C 

45 C PRTMT INPUT ARRAYS 

^6 C 00009750 

47 IF (N.LE.9) M«V 

48 IF (M»GT»9) M»9 

49 L«l 

50 CALL OTEOAl(C^y/MU") 
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A FORTRAN IV ' ER S43) SOU«C^ CiSTINGi OTPOOl PROGRAM 04/10/75 PAGE 0004 

151 IF (N,LE,9) GO TO ^l^ 

152 !F(NM.E.18) m.m 

153 IF(N.CT,18) M«i8 

154 L»10 

155 fAlL OTEOAKLiMiMjM) 

156 IF(N.LE,18) GU TO 

157 M«M 

15S L«19 

159 CALL DTEOAKL/MiViU'M 

160 5lO WRITE(6/90) V' 

161 w.RTTE(6iU3) FAC^ST 

162 WR1TE(6/117) RLftF^A 

163 WRITE(6,101) S^FTlv 

164 WRITE(6/102) SOFTST 

165 WRlTE(6ill8) SOFIA*' 

166 WRlTe|6/ll2) fcOCtSP 

167 WRlTE(6,il6> RLOcgi 

168 WRITE(6/Ill> EOIMPC 

169 WRTTE(6il07> LOFFQ 

170 WRTTEI6/94) TSPO^O 

171 'JRJTEI6/IU) UlMfi 

172 VRTTEI6/103) UPQaTF 

173 VR1TEI6/108) EVIM 

174 vrRiTE(6/104) CIM^ 

175 WRITE(6/100) IN'TSP** 

176 WRITE(6/IC5) SALINP 

177 VRITE|6^106> SUPPLY 
17B VRTTE(6a09> STUPSi 

179 wRTXE(6/97) STCSTl ♦ 

190 VJRTTE(6/98) STCST2 

181 WRlTE(6i9l) ARATf 

182 WRJTE(6/110) DRATE 

183 WRlTE(6/93) V'SCHn? 

184 wRITE(6/92) TLFNGH 

185 WPTTEI6/115) TLEGTv 00013150 

186 V*RjTE(6/95) HCRATE 

187 V.'RlTE(6/96) AKCYTM 

188 VRTTE (6/99) E^P 

189 C 

190 C PRU!T OUTPUT ARRAY'S 

191 C 

192 500 IF (^^^LT,lO) M-N 

193 IF (N.GE.IO) ^^«9 

194 1=1 

195 l^«f. 

196 V'RITE(K/Il) 

197 WRTT£(K/10) <ALPWAl(I),I«i,20) O0015600 

198 WRTTE(KilO) < ALPMA? ( I ) J I » 1/ 20 ) O0015700 

199 CALL OTEOBKL/^^) 

200 IF (N,LE,9) GO TP 751 
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A FORT'»A^' IV <V6R S<(3) snoPC* '.I<T1NG« OTFOOl PROGRAM O^/IO/TS PACE 0005 



201 






TF(*ME,18) '^»»^* 




202 






lF(i!,CT,18) M«i5 




203 












20^ 






CALL DTEOBKL/^) 




?05 






lF(?'.Lt.ie) Gu TH •'SI 




2U6 






1 «19 






207 












20^ 






/•Al L DTEOBUC 






209 


c 










210 


C 




npi!JT OUTPUT 


SUMMA'>Y 




?U 


c 










212 




75 \ 


IF(M.GT.l8) '*>KITP('-//tn 




213 






vmtTE(K/7ll) 


AAST.N 




2U 






V.'RlTE(K/729) 




^0016700 


215 






vPTTE(K/712) 


PVALUc 


'^0016800 


216 






•^RTTH(K/713> 


H4 


00016900 


217 






•'•R!TS(K/714) 


CI 


00017000 


218 












219 






♦-•RTTc(K/71tj) 


t3. 


00017200 


220 






VRTTF(K/717) 


cAOr I 




221 






'.'RITE<K/713) 


Fac^St 




222 






"PlTg{K/7l9> 


Ar imJ) 




223 






vRTTe<K/720> 


CTNT 


00017600 


224 






••'PTT6(K/721) 




00017700 


225 






'•♦P.TTE(K/722> 


rvVp' 


00017800 


226 






i''RlTE{K/723> 






227 






VR»TE(K/724> 






22^ 






'''RlTE(K/725> 


T^QFT 


00018100 


229 






vPITE(K/726) 


ANC^P 




230 






v'RlTE(K/727) 


Anc«? 


00018300 


231 






'»RTTG(K/728) 


ACSP 




232 






V'RTTEI6/731) 


UAC 




233 




75? 


IF(KEY(2)M'^E.i> GU TH 75^ 




234 












235 






TDATA(NRUN/ n«PV4t«'E 




236 






TDATA(NRUN/2)«ri 




237 






T0ATA(NRUr^i/3) 


■UAr 




?3e 






TD^TA(NRUM/4) 


«r i^'T 




239 






T0ATA(^jRUK'/5) 


«5IVt5TR 




240 






TDATA('-RUl;/6) 


«cp'STRa) 




241 






TPiATAl IRU^'/7)«"N^P 




242 






tdATA(.*-:RUN/8) 


•TLrOTH 




243 






TF(KEY(3),EQ, 


1) CALL OTE'^uUMEO/LC) 




244 






r.n TO 200 




00018500 


245 




990 


IF(KEY(2).E0, 


X) CAa OTE'^CI(MRIIN) 




246 






IF(K£Y(3),I:Q, 


n rUKl DTEOtl 




247 






GP Tn 3 






24fi 






<;Tnp 






249 






PnP^AT(lOF8.?) 




250 




l'^ 


FOP.'ATdH /2"A4) 


00018900 
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0^/10/75 



7.5\ 
252 
255 
?5A 
255 
256 
257 
258 
^9 
ZOO 
261 
262 
2b3 

26<r 

265 
266 
267 
268 
269 
270 
271 
272 
273 
274 
?75 
276 
277 
273 
279 
280 
261 
282 
283 
284 
285 
266 
287 
238 
289 
290 
291 
2«>2 
293 
?9A 
295 
296 
297 
29^ 
299 
300 



n cca;'*^ (IHl) 
1^ PCo'»AT(2CA4) 
1^ F0OrAT(l8A4^?l4) 
14 COO.'^AT(3I1) 

FC»M.AT(lHX^6r,X^ tTN'^UT PATA») 
90 FnoVAT(lX^ iNDi OP YEARS IN PLA^'NING PER ICO f>X^ I To ) 



PAGE 0006 



00019050 



91 FOPMATC 
9^ FOPMAT( 
9^ PO«?iAT( 
94 FORMAT ( 
9'5 cO'>MAT( 

96 FQP^•AT( 

97 FQonAT( 
9« C09MAT( 
99 FQ&>»AT< 

ion FOerAT( 
ICl POTATC 
1?? FO'MATC 
103 FCo,«AT( 
lOA FOP;^AT( 
IC5 POeKAT( 
ICA FOOJ<AT( 
1C7 POP^AK 

io« por;<at( 
ICO fop?;at( 

ll'^ C0«>*^AT( 
111 PO'?? AT( 
11? FURi^AT( 
m POP/AT( 
U4 FOP"AT( 
l<; np l;.^ 
lis FOo'tAT( 
11*> FO^J^ATC 
117 FQ0MAT( 
FDf>;'AT( 



ATTBlTinN RATE^26X/F10.2) 
lEMJU nf T•^AINI^^^r. IN WKS'. I ^ 14X/ F 10 . 2 ) 00019500 
WEEW.b SCHOOL aPFKATES/YR)jl6X^F10a) 

TIMF <;TUOcNT PQ^ ARP D0WN»^15X^F10,2) <^0019700 

RECYCLE R/TF ^27X^P10.2) 00019800 

AVE. RErYrLF TjMfc I^, WKSi;i6x/F10.2) 00019900 

AVE. STMOPNT TRAVFl COST TO/FROM SCH I / 4X/ F 10, 2 ) 

AVE. STl'D'^NT TRAVFl AS A PART OF COURSE i;f10i2) 

EXCFS5 vO\ HF STuHENT POS I T IONS » ^ 9Xi F lo'.2 ) 

INSTR./<:T' QCNT PDS. R AT 10 » ^ 15X/ F 10. 3 ) 

SC FT/IMSTR. POS, ^?3X/F10.1) 

SO FT/STu'^EMT pnS . ^ 22X^ FIO, 1) 

UPOATF FArTrR!^?7X/Fl0.2) 

HGUPLY rO«T UF TMD I > 22X> F 10. 2 ) 

SALARY PF OMc INSTR . I , 20X7F10 • 2 ) 

supplied; <'0«:T/STU0ENT'il9XiFl0.2) 

LIFP OF STUf^ POS FQUIP <;i6XiF10a) 

VALU£ OF llA AT F:>}D QF PLANNING PER. »/5x;F10.2) 

STUOtN'l S*LARY'>26X>F10.2) 

OISCuUNT ?AT£t>?7X>F10.2) 

EQUTK>cN-T T'f'LE^EfnATICM COST/STUD POS i;f10.2) 
EQUIP. !iM?>LFM\ COST I^rQEPENO. STUD POS i;f10.2) 
FACILITIES ACOUISTIHN OR REFURBISH COST i;F10.2) 

PER CENT '^F TRAINING MEOIUM TlME!/> RFQiHHlNC UNIOUF. H0UR00021700 



.D»/llX>Flo.?) 

AVE. ^k</ K. 5PF.^iT ir: TRAINING MEDIUM IJfIO.I) 
LIFP np I•'PLcME^JTATrO^• EQUIPMENT I i 8Xi FiS,? ) 
EXPFCTEn licfc OF FACILITIES ( YEARS ) » > 5x;F 10 . 2 ) 
TOTAL S" -T RFQUlPEn FOR AOMIN OVERHEAD i;F10.2) 
rUTPUT FORMATS 
711 POorAT(//^i AVC. A^Ni'AL STUDFMT INPUT I > l5Xi FlO'. 2 i 



00021750 



71? CQnMAX( 

71? FOP| AT( 

71A PUi^vATC 

71«> rODrAT( 

716 =U0! AT( 

717 FnP^AT( 
7ia F0OMAT( 

719 Fr"?r.AT( 

72"> FPDMAT( 

7?1 FOP?'AT( 
72^ ^AT( 
72^ FOe^AT( 



PRE«c\T C"ST OF ALTFRMATIVE«i9XiFl4*.2) 00022800 

ND^^^>lscru^ T=:> c^^st ^f alternative »iXiPi4.2) 

AVE. OMCuVTFD CnST/GRADUATEMlXiFlO.?) 
^^U^JOISC^U» T'^u C"ST/ORADUATFt>13XiFlO,?) 
AVE. '^I'^C'-UVTED CPST/STUDFNT POSITION iJf10".2) 
INITIAL e^OTP/'E^'T ACQ"ISTIDN COST i ;F14.2) 
I«^IITIAL FnrilTlfcS ACOUISTION COST i;f10.2) 
INITIAL I" f>cV CGST»i?lXiF10.2) 

INITIAL bvST£M ACOUISTION COSTi/l FOR F AC T L I T I ES/ EQUI Pi AN 
8XiF!4,2) 

REMMM^'G VAuUE OF cCjUlPMFNT 12XiFlo;2j 

REMAIM^'G VALl»E I f • > l9Xi F 10. 2 ) 

NC. uF TN^TOUCTHR*: R EOU I RED M3Xi F 10 , 2 ) 
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A FORTRAN !V (VER S43) SOUK? CiSTINGi DTEOOl PROGRAM 



0^/10/75 



PAOE 0007 



301 
302 
303 
304 
305 
306 
307 
308 
309 



724 
729 

726 
727 
72^ 
729 
730 
731 



FOR.MATP 
PORKATt » 
FOty.AT( » 
PORiMAK I 
PD».MAT( » 
PQPMAT{ I 



NO. UP ^Tt'OPNT PDSITinNSt;i6X/Fl0.2J 
FACILITY SEOUIRPHFNTS IN $Q FTMOX/FlO':2 J 
AVE, ANMU4L NDNOl*:. COST/STUD POS « / 7X/ F10'.2 ) 

OISCUUNTtO COST/STUO P05 i;f10.2) 
COST/STUO POS tjl4X/Fl0.2) 
NO. CjF students on B0AR0i;4X/Fl0.2) 



AVE. ANNUAL 
ACOUlSTflTN 
AVE. ANMUAL 
FOPMATUHO) 

FQPKATP UNIFOPM AK'NUAL COST » / l7Xi FU. 2 ) 
FNO 



00021750 
00023950 
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i FORTRAN IV (VER SA3) SOU^Cf TlSTtNGl OTEOBl SUBROUTINE 



04/10/75 



PAGE OOOB 



I 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
16 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 



SU^IROUTINE OTfcOBi(C/M) 
THIS SUBROUTINE PRINTS OUTPUT ARRAYS 

COMMON STUD(30)/PC'^ST(30)/TA6QC(30)iAIHMC(30)/ClMSTR(30)iSUPPY(30) 
IiSSALRV(30)/UDAC^T>3A)/T(30)iNUW(30)iAOB(30) 

WRITE(K/700)L/^' 

VRTTE(K/710) (^'UM| r );i«L/r".) 

WRITE(K/701) (STllDd)/ I»L/M) 

WRITE(Ki7l2) (AO»(T);i.L/M) 

WRITE(Ki702) (FC!?ST( I ), I«L/K) 

WRITE(Ki703) ( TAPQC H ) / I ■L/M) 

WRlTE(Ki704) ( A IHMf ( I ) / I «L/ M) 

V'RTTE(Ki705) (CZHStR( I I«L/M) 

WRITE(K,706) ( 5UPPV ( I ) / I ■L/M) 

WRITE(Ki707) ( SSALoW 1) / I ■1/ M) 

WRITE(Ki7C8) "lT(t);i«L/M) 

WRTTE(Ki70?) tUOAC<T(I)/I»LiH) 
VRlTS(Ki7U) 



700 
701 
702 
703 
704 
705 
706 
707 
70« 
709 
7ln 
711 
71:? 



C0021940 
00021950 
00021960, 

00001500 



00025100 



00025400 
00025500 

00025700 
00025600 
00025900 



PRINTER OUTPUT DATA FORMAT COOES 



FOtMAT(lHO,T*Oi »rUTP'iT SUMMARY YEARS » 1 2/ M2 ) 
F09^'AT( IHOi ISTUOFNT INPUT I / 27Xi 9F 10 . 1 ) 

FORMAT(i NDNnlSCeU^'TcO ANNUAL FAC. COSTi/ lOXi9Pl«,C) 

NONOlSCnU^'TEO ANNUAL 

NON'ilSCnUvTED ANNUAL 

NDNOlSCnuVTFO AN.sUAL 

NONOlSCnUVT?0 ANNUAL 

NONOISCOU^'TPO A^JNUAL 

NDNOlSCnuvTFO ANNUAL 

NONOISCOU^'TEO ANNUAL 



FO'^'^iATC I 
FORMAT ( I 
FDR»^.AT( » 
FO«MAT( I 
FOR(^.AT( I 
FORMAT ( I 
FORMAT ( • 
FORMAT ( I 
FOP^'AT( IHO) 
FOPSAT( I AVE. 
RETURN 
6Nn 



FQUIPMENT COST liAXi9Fl0.l) 
I« CnSTU2X,9Fl0.l5 
INSTR, COST t,7Xi9Fl0a) 
SUPPLY COST li7Xi9Plft.l) 
.STUDENT SALARIFS i;9FlCil) 
TRAVEL COSTIi8Xi9FTo'.l) 
OPERATION C0ST»5X,<?F10.l) 



YEARIi42XiI?i8(9X>I2) ) 



^'O; «F STU'^ENTS HN BnAR0MUi9Fl0UJ 



00024950 
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A FORTQV' IV (VER S43) Snu»C? TltTlNOJ OTEOAl SUBROUTINE 0^/10/75 PAGE 0009 

1 <^'Jn'<aUTIME ')Tb''At (C/M/K'U'U) 

2 C 

^ C ?MPKOUTIt;E PRINT IN^UT arqaYS 
4 C 

6 '■nM.'3'^l/IMVAR/0eAn(10»/CP^wFT(3n)/COPMT(3O)/CAQ5p?3«)/UIMDYR(30j/nM 

7 lFF'>(30)/RLaFPg(3f)) 

9 '''PTTECK/IO) (HUMl ( T );i«L/M) 

10 WRTTE(K/11) (OPAO( ^/^«L/^^) 

11 '.JRTTe(K/12) (CPSOFT(T)^l«L/M) 

12 '''P.IT^CK^ 13) (CrpfiTf D/IkL/'M 

13 '•'RTTfc(K/17) (U?'FPg(n/I»L//') 

14 ''/RlTclK/XA) (CAQSPM)/I»L/^M 

15 VRTTE(K/18) (KlOPE'^(T)/I«L#H) 

16 VRrTE(K/15) (U!M'^Yr(T)/I•L>^^) 

17 '*'R!TE(K/16) 

18 RETURN 

19 1-^ FO!>'^AT(» Y6APl/4>X,I?/a(<^X/I2)) 

20 n P07,:aT( iQGRAnUATPS RFQO, /YFAP »;20X/9FlO. 1 > 

21 n FD^^MATC* CUST/SO Ft, !,29y,9FlO,2) 

Z2 n Fa&MAT(> OPFBATlnN A^O MftPlT, f.OST/YR, »/ llX/9Flo;2 j 

23 \4 FOef:AT(i AMM"IAL AC^UISTIHN COST/STUD. POSW SX/9clft.2) 

24 n PORMAT(i UNIOUP WOMR^ OF I MQ/YR » > 1^X/9F 10, 1 ) 

25 16 FUPl^ATdHO) 

26 17 Rn&'MT(t OCM COST -^F FIX^O EOUIPM£NTM3X/9F10i2i 

27 lA FOovtAT(t EXPRCTEp ClPE QF CAOS^d) ASS ETS I / 8X/ 9f iQ*. D 
2fl PNO 
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A FORTRAN' IV (VtR S^3) Snu«C5 CiSTINfil OTEOCl SU3R0UTIME 0^^/10/73 PAGE 0010 



1 ^U-^OQl'TIME DTtOClC^CT) 

2 C 

3 C ARr,MM£NT I - KCT - NOi OP RUNS 

4 C 

5 C THIS S'OBRQUTIN? PRtNTS A SUMMARY TABLE 

6 C 

7 OI^ENSION LAREL'(75;7i 

8 COH.SQN /TABLf/ TnATA(15>a) 

9 C 

10 C INITIALIZE SUBtOUTINP! VA^UbCES 

n c 

12 ISTART»l 

13 IEWO-4 

14 THFAD-1 

15 C 

16 C "UILO LABEL TAPLF 

17 C 

IB !S«1 

JHALT-5 
ZO 2 00 9 I»IS>IHALT 

21 o PEAC(5>10>EMn»3) (CARtL'( 1/ J)> J»l>7) 

22 lSxIS+5 

23 IKALT-IHALT+5 

24 r.Q TO 2 

25 * IFdHEAD.NE.l) OP tq 4 

26 VRITE(6>15) 

27 KRITE(6>19) 
23 VRTTE(6>11) 

29 WRITE(6>12) 

30 vbttE(6>13) 

31 wRJTE(6>14) 

32 V*PITE(6>19) 

33 IHPAD-2 

34 rD TO 5 

35 4 IF(KCT,GT.3) WPItE(6;15) 

36 vRTTE(6>19) 

37 •>R1TE(6>16) 
3P •.'R1TE(6>17) 

39 wRTTE(6>16) 

40 VRITE(6>19) 

41 IHPAD-3 

42 15 = 1 

43 IH&LT-5 

44 no 50 Kl«l>KrT 

45 vRiTE(6>20) 

46 no 6 I1=IS>IHALT 

47 IF(Il.NiE.IS+?) Gn TO 7 

48 vp.iTE(6>2l) «LABRL(Il>J)>J«l>7)^ (TDATA(KU J )i J.TSTART# lEND ) 

49 CD TO 6 

50 7 i^'RITE(6>22) f CAB^L ( I U J ) > 0«U7) 
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A FORT^AM IV S43) SPU»CF Cl^TINGl DTFOCl SUBRQUTIMe 0^/10/75 PAr,E OOll 

51 6 COMTINUE 

52 WRlTE(6/20) 

53 WRITE|6il9> 
5<» !S»IS*5 

55 IHMT«IHALT + 5 

56 5Ci CONTINUE 

57 IF(IHEAD.EQ.3) RFTt'R^J 
5S ISTART35 

59 IEM0»8 

60 r,Q TO 3 

61 10 Fa»f4AT(7A<») 

62 n FOPMAT(i ♦l/T32/l*f/T^2^ ipo6SEMT»/T57, »♦ AVERAGE DISCOUNTEO *l 

63 1/T91/ IUNIF0RMI,T107/ I* ACOUlSTinN COST ♦M 

64 1?. FO'^.'^AT(i ♦l/T32/f*»/T43, 'CnSTi;T57/ »♦ COST pFR C'AnUATE ♦i^TB 

65 19/»AWAl C0^T!/Tl-s7; !♦ FuP FACILITIES /EQUP, ♦> )' 

66 n FQRf^AT(i ♦ I / T3?/l ♦ ! ^ T57/ » ♦ S T82/ « ♦ T 107/ t ♦ AND TnSTRUCTIDNAC 

67 1 

6« U FOJ^MATCi ♦»/T32/l«!/T57i »«»iT82i •♦t/TlO?/ <♦ MaTERIH OEVELOPEMFNT 

69 1 ♦» ) 

70 15 FOOMAT(IHI) 

71 16 FORNlAT(i ♦t^T32/'*«/T42/ »N0, 0F»/T57W*i/t Now-niSCQUNTEO 

72 1* NO. OF <!TUOF^^T ♦ AVERAGE HOURS PER ♦») 

73 17 FO^I'^ATci ♦i,T32/ !«»/T3«>/ » INSTRUCTORS!, T57/ I* AK'Nl'AL INSTRUCTJ^R 

74 1 ♦ POSITIONS RFQ«;I«£0 ♦ GRADUATE IN MODULE 

75 1^ FOPy,AT(» ♦l,T32/!«'f IK' MAN^YEARS PER YEAR) * » ,7^77 t^OST » , T82, » ♦ i ,Tl 

76 1^7, t*^T132, t«i ) 

77 19 FORMATdH ,32( l***> ) 

78 2n FO«>MAT|l ♦i,t3?., i«I/T57/ i*i/T82/ •♦t,TlC7W*»iTl39/t*i) 
79. 21 FOl>MAT(lH ,7A4, » * I > 4 ( F 14 , b SX, » ♦ M ) 

80 2? FCRHATdH i7A4, I ♦ » i'4 (^^Xi » ♦ t j ) 

81 FNP 
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A FORTRAN IV (VER S43) SOURCF i.l^TINGt nTFOOl SUBROUTINE 
: THIS SUBROUTINF ST"RcS OUTPUT TABLF VALUES 



0^/10/75 



PAGE 0012 



10 



CO^^m /DVAR/C0ATA>2«) 
CDMHQM/TVAR/ X( H^^t/JiO) 
no I I>I/20 
1 X(^'EO/LC/I)"CDATMf ) 
PETURN 
FNO 



no 



FRir 
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4 FORTPAK' tV (VtR S43) SD'JPC? LISTING! OA/lO/75 PAfiE 0013 

1 ^JU^PQUTINE O^E'^EJ 

2 C 

3 C THIS SUBROUTHMF PRINTS U TABLb 

4 C 

5 rov^'lN /TVAR/ X(l5iB/2r) 

6 DiMFflSION IVARVlo) Mr.ATI 16 ) / MEOI A ( 15/ 4 ) 

7 C 

8 C REAP CATEGORY HEiOTN''.S ANC Nn, QF MEDIA CARDS 

9 C 

10 oRAD(5/16) (lC&TfI\/T»lil6)iNCT 

11 ISTal 

12 TfcNt»5 

13 ICTeO 

U ? PEA0(5/17) ((ttrDtA'I/J)iJ«b^);i«ISTilEND) 

15 KT«:ICT+1 

16 IP( ICTpEO.NCT) or TQl 

17 JST.IST+5 
11? IE*«r,«IEN0+5 
1? GO TO 3 

20 C 

21 C PFAr TABLE VARlA9Ll= AND NU, OF MIrDtA TO BE Pi^r»TFD 

22 C 

23 1 «>FA'"(5il0iEND»!0n) ( I VAR ( I )/ I«l/ 19 )/NVAR/NHEn 

24 '^RlTEIfe/in (l\'A^(T);i«l/19) 

25 vRTT:i6il2) 

26 ^'RTTE(6/13) 

27 VRiTE(6/U) |ICAT(n;i«l/l*^) 
23 '''R»TE|6il3) 

2«> '-'P.ITE(6il2) 

3?> no 2 Kicl/NME'^ 

31 WRTTEI6/13) 

32 WRTTEI6/15) (rlCDtAfKiJ)iJ»li4),(X(KiLCiNVAR)iLC«T/'') 

33 ^^R»TE|6il3) 

34 7 ^PTTE{6il2> 

35 ni) TO 1 

36 IC^ PETL'RN' 

37 1'^ F0»^'AT|l9A4i?I?) 

39 11 P^f»^:AT(lHUlQAA///^ 

39 17 PO'^SATdH /31( r*i ) 

40 n Fn'?r*AT|» *»iT<i2^ |#i^fi(i2X/ »*t ) ) 

41 lA PCe>^'AT|» ♦ » /Tii?/ f * i , | ?Xi 2A4i 2Xi « * i ) ) 

42 IS F^»^''AT|» *i/2Xi4i4;! *»/*(1X/F10.1; » ♦»)) 

43 1^ P0P,'AT(16A4/«Xi I?) 

44 17 Fno"AJ|20A4) 

45 cK|n 
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♦** DATA PECK LISTIMG *♦* 



RUN 10 






INST^UCTir^AL 


nFLlVEP.Y 


5 Y ^ T C ^ 


0, 


r. 


64. 


7P ■ 


1,0 




0. 




10. 




O.IO 




2.75 


?.75 


2.75 


* . '5 


0, 




.0. 




0. 




0. 




I50t 




I5v. 




0, 




0. 




1300. 


14no. 


1300. 




0. 




0. 




RUN ID 






INSTPUCTIO^^AI 




$YbTE»» 


Ot 




64. 




I. 




^. 




io« 




.IC 


*?(;. 


2,75 




2.75 




0. 




0. 




0. 




0. 


n. 


15. 


13. 


15. 


13. 


0. 








1300. 


lA•^0. 


13C0. 


5 2ro; 


0. 




0. 




END OF 


FTLP r'nlCATOF 






SYSTE 


A 





- IHERATIOMAL SYSTEM lU A LAf^O»ATO»Y WITH 



ion, 
?.75 

. 

'J. 

120C. 



0; 

16240. 

:?.75 

I5n. 
^. 

Jl'^O. 



0». 
0. 
0. 

2.75 
0. 

15C. 
UGO. 



BO'^C. 
UUl. 

0. 
^. 

iKo: 

0. 



10. 
0. 

0.05 
2.75 

C. 

I5i . 
0. 

HOC. 
C. 



I 

TUTOR 

.01 

n, 

2.7SJ 

11*0. 
n. 





FISHE WITH 


PHCTL-. 


MOCKUP 




2 


U«0. 




' . 


275. 


10. 


.01 


.1 


16240, 


C. 


llUl. 


0. 


Oi 


.1 


4, 




.1 


• 05 




'.75 


9.75 


2.75 


2.75 


2.75 






n. 










. 






f-. 


0. 






13. 


15. 


15. 


15. 


J 5'. 






t . 


0. 

.IKo; 








ll'»0. 


1K»0. 


HOC. 


U'^O. 








0. 


0. 


n. 



♦ OPcRATir^'Al SYSTEM pi 

* LABIJOATITRY WTTM TUTOR 



SYSTE^' 3 

MIC?^0FISHP '•'ITH PMOTC 
MnCKUo 



4> 
♦ 

ENO OF FILP I'"!'^ICATOR 
CAT 1 C^T 2 CAT 3 CAT 4 
OP. SYSTE^' MlCRPFl^Hc 
NONDISCOL'flTEr rCST PER GOADU^T 
NOMDISCUMiiTEf^ COST OF ALTkP^*T 
INITIAL IV';Tt>UrTIOf!AL '^tATbJ^lAt 
ENO OF FIL«^ IM'^ICATOR 
ENO OF FiLc IM'^ICATO:^ 



CAT 3 CAT 6 
CAI 

c - EXAi'OLF J 
l)CVFL"^^PMPNT COST 



Cn 7 CAT 8 
PT LUi^AO 



1 

PT Bf^AMCMjvG 

6 3 
4 3 
10 3 



DNH np ltst ♦♦♦♦ 
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COST DATA COLLECTION FORM 

Instructional Delivery System 

Run ID 



Symbol 


Variable Description 


Value 


Units 


Facilities 








FACOST 


Total facilities acquisition 
and/or refurbishing costs 




Dollars 


LOFFA 


Expected years of life of 
FACOST assets fin whole numbers) 




Years 


SQFTIN 


Total square feet required 
for each instructor 




Sq ft 


CnCTCT 


Total square feet required 
per student position 




Sq ft 


SQFTAM 


Total square feet required 
for administrative overhead 
for all student positions 




Sq ft 


Equipment 








EQCISP 


Equip, implementation costs 
independent of stud. pos. 




Dollars 


LOFEQl 


Expected years of life of 
EQCISP assets 




Years 


EQIMPC 


Equip, implementation costs 
per student position 




Dollars 


LOFEQ 


Expected years of life of 
EQIMPC assets (in whole numbers) 




Years 


TSPOSD 


Percent of operating time 
student position down 




Percent 
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Symbol 


Variable Description 


Value 


Units 


Instructional Material (IM) 




Percent 


UIMD 


% of TLENGH (i.e., time spent 
in training medium) for which 
new instructional material 
must be developed 


UPDATE 


% of original development cost 
required each year to maintain 
instructional material 




Percent 


hVlrl 


% ot original development cost 
remaining at end of planning 
period 




Percent 


CIMD 


Average cost of developing 
one hour of instructional 
material 




Dollars 


Personnel 

111 1 orU 


Instructor to student 
position ratio 




Decimal 
Ratio 


QAI TMD 


Annual salary and benefits of 
one instructor 




Dollars 


Suppl 1es 
SUPPLY 

- 


Cost of expendable supplies for 
each student while enrolled in 
course 




Dollars 


Students 
STUDSL 


Annual salary and benefits of 
one student 




Dollars 


STCSTl 


Average student travel cost 
to and from school 




Dollars 


STCST2 


Average per student travel cost 
as a part of course 




Dollars 


Miscellaneous 
N 


Number of years in planning period 




Years 


ARATE 


Attrition rate 




r C i V«C1 1 L 


DRATE 


Discount rate 




Percent 


WSCHOP 


Weeks school operates each year 




lJpp|/c 

riCC NO 


TLENGH 


Average time spent in training 
medium per student 
(non-recycled students) 




Weeks 


TLEGTH 


Average hours per week student 
spends in medium 




Hours 


RCRATE 


Recycle rate 




Percent 


ARCYTM 


Average time the recycled student 
spends repeating material 




Weeks 


ESP 


Percentage of excess student 
positions required to provide 
for fluctuations in input 




Percent 



NOTE: All percent values are entered as decimal equivalents. 



114 

124 



TAEG Report No. 16 
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o 
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cr> 


































cc 


































>- 


>- 


































00 
































00 
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>- 
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CO 
































CO 


r- 




































































































>- 


>- 


































oa 
































CVi 




































oc 
































>- 
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r~ 




































































































>- 


>- 








































































>-H 


to -P 


















to 








o c 


















Q) 






CI. 


O 0) 


















•r- 
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00 


TJ 


«3 to 










rd S- 






4J 


o 


o 


cr 


• 3 




-o 








0) 0) 






•r- 


•r- 


•r- 
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4J 4^ >- (tJ 


0) 




o 






>- ^ 










4J 


4J 
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C 00 








au 






E 






•r- 


to 


•r- 


•r- 




•r- 


JC r- 






»— < 






JC 3 






U 




to 


to 


«+- 




U O 




(d 








to 


u z: 






(d 


(d 




O 


o 




ft3 CD 






«+- 


to 




0) 


rd 






Lu 










Cl. 


LU w 






o 


u 




4J 


LU 


LU 








cr 




Q) 


to 
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o 








rd 








U 


o 




«+- 


u 


C -P 








to 


o 




3 


s- 


CO 




o 




< 


C 


•r- 


in 


<n c 


o 


to 








-o 


o 


< 




<+- 






Q) 


-J 


0) 




•p 


=3 






rd «+- 
















>- 


C E 




to 


•p 


o 
















C 


=3 


TJ 




O CL C 


o 


c 


X 






o -a 


< 






trs 


0) 


4J 


0) 


•r- 


o 


o m 




rd 








> 




Lu 




E 00 


•P 


to 


4^ =3 






0) 


(U 






u 








>- 




U 




*t3 CT-P 


au 


CL 


3 >- 




o 


•r- 








•r- 




0) 


0) 


U LU 


•r- 




•r- 


cr 






3 






to 


5- 




to 


CL to 




to 




=3 


•r- 






• 


cr 






O 


0) 


cr o 


X 


to 


cm- 


O 




cr 


C 


0) 




o 


(U 








LU 


O 


LU 


< 


O O CL 


O LU 


r) 


CL 


fd 


z: 
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>—* 




fd 






-J 
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OC 
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(/> 










cr 


J- 




cy 


>- 
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CO 




0) 


or 




00 




LU 


z: 




LU 


CI) 


•r- 






z: 




•r- 


00 
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cr 




Lu 


CL 




Lu 


to 


z: 


4J 






>- 




•P 


Cu 


0) 
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00 




•r- 
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CD 












a 














0) 














•r- 




•r- 














-a 




4J 
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=3 
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to 










(d 
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4J 
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Lu 


















00 
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